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Preface 


The importance of partial differential equations among the topics of applied 
mathematics has been recognized for many years. However, the increasing 
complexity of today’s technology is demanding of the mathematician, the engineer, 
and the scientist an understanding of the subject previously attained only by 
specialists. This book is intended to serve as a supplemental or primary text for a 
course aimed at providing this understanding. It has been organized so as to 
provide a helpful reference for the practicing professional, as well. 


After the introductory Chapter 1, the book is divided into three parts. Part I, 
consisting of Chapters 2 through 5, is devoted primarily to qualitative aspects of the 
subject. Chapter 2 discusses the classification of problems, while Chapters 3 and 4 
characterize the behavior of solutions to elliptic boundary value problems and 
evolution equations, respectively. Chapter 5 focuses on hyperbolic systems of 
equations of order one. 


Part II comprises Chapters 6 through 8, which present the principal tech- 
niques for constructing exact solutions to linear problems in partial differential 
equations. Chapter 6 contains the essential ideas of eigenfunction expansions and 
integral transforms, which are then applied to partial differential equations in 
Chapter 7. Chapter 8 provides a practical treatment of the important topic of 
Green’s functions and fundamental solutions. 


Part UII, Chapters 9 through 14, deals with the construction of approximate 
solutions. Chapters 9, 10, and 11 focus on finite-difference methods and, for 
hyperbolic problems, the numerical method of characteristics. Some of these 
methods are implemented in FORTRAN 77 programs. Chapters 12, 13, and 14 are 
devoted to approximation methods based on variational principles, Chapter 14 
constituting a very elementary introduction to the finite element method. 


In every chapter, the solved and supplementary problems have the vital 
function of applying, reinforcing, and sometimes expanding the theoretical con- 
cepts. 


It is the authors’ good fortune to have long been associated with a large, active 
group of users of partial differential equations, and the development of this Outline 
has been considerably influenced by this association. Our aim has been to create a 
book that would provide answers to all the questions—or, at least, those most 
frequently asked—of our students and colleagues. As a result, the level of the 
material included varies from rather elementary and practical to fairly advanced 
and theoretical. The novel feature is that it is all collected in a single source, from 
which, we believe, the student and the technician alike can benefit. 


We would like to express our gratitude to the McGraw-Hill staff and the 
Colorado State University Department of Mathematics for their cooperation and 
support during the preparation of this book. In particular, we thank David 
Beckwith of McGraw-Hill for his many helpful suggestions. 


PAUL DuUCHATEAU 
Davip W. ZACHMANN 
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Chapter 1 


Introduction 


1.1 NOTATION AND TERMINOLOGY 


Let u denote a function of several independent variables; say, u = u(x, y, z, t). At (x, y, z, £), the 
partial derivative of u with respect to x ts defined by 


ou u(x +h, y, z, t)- ul, y, Z, ot) 
Ox sak h 
provided the limit exists. We will use the following subscript notation: 
ou ou au = ou au au 


= =u —= = —r=u 
ax * ay ° ax? 


u = 
= ay’ ay Oxdy ay ax? faa 


If all partial derivatives of u up through order m are continuous in some region , we say u is in the 
class C"(Q), or u is C” in Q. 

A partial differential equation (abbreviated PDE) is an equation involving one or more partial 
derivatives of an unknown function of several variables. The order of a PDE is the order of the 
highest-order derivative that appears in the equation. 

The partial differential equation F(x, y, 2, t; u, u,, Uys Uys Uy Uyys Uyyy >» .)= 0 is said to be linear if 
the function F is algebraically linear in each of the variables y, u,, u,,..., and if the coefficients of u 
and its derivatives are functions only of the independent variables. An equation that is not linear is 
said to be nonlinear, a nonlinear equation is quasilinear if it is linear in the highest-order derivatives. 
Some of the qualitative theory of linear PDEs carries over to quasilinear equations. 

The spatial variables in a PDE are usually restricted to some open region Q with boundary S; the 
union of (2 and S is called the closure of Q and is denoted Q. If present, the time variable is 
considered to run over some interval, t,<¢<¢#,. A function u = u(x, y, z, t) is a solution for a given 
mth-order PDE if, for (x, y,z) in O and 4, <t<4, u is C” and satisfies the PDE. 

in problems of mathematical physics, the region O is often some subset of Euclidean n-space, R". 
In this case a typical point in © is denoted by x= (x,,x,,...,%,), and the integral of u over { is 
denoted by 


[--f U(X Ry. %) dey dry de, = | udQ 
a a 


1.2 VECTOR CALCULUS AND INTEGRAL IDENTITIES 
If F= F(x, y,z)isa C' function defined on a region 2) of R?, the gradient of F is defined by 
OF. OF . OF 


rad F=VF= i+ jt k 1.1 
Ox ay oz sted) 


If n denotes a unit vector in R°, the directional derivative of F in the direction n is given by 
OF 
—-=VF-n (1.2) 
on 
Suppose w = w(x, y, z) is a C’ vector field on Q, which means that 
w- w, (x, ys zit w(x, y, z)j + w(x, y, z)k 


for continuously differentiable scalar functions w,, w,, w,. The divergence of w is defined to be 
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ow ow, aw 
dsp Pa Sigs 8 


divw=V-w= —+- (1.3) 
Ox oy Oz 
In particular, for w = grad F, we have 
, dhe OE OP oF 
div grad F=V‘VF=VF . Fo Ry hy (1.4) 


ax’ ay” az 
The expression V’F is called the Laplacian of F. 


Theorem 1.1 (Divergence Theorem): Wet 0 be a bounded region with piecewise smooth boundary 
surface S. Suppose that any line intersects S in a finite number of points or has a whole 
interval in common with S. Let n= n(x) be the unit outward normal vector to $ and let 
w be a vector field that is C’ in Q and C° on 2. Then, 


| Vewao= | wenas (1.5) 


If uw and v are scalar functions that are C? in Q and C' on Q, then the divergence theorem and the 
differential identity 


V:(uVv)=Vu-VotuVvo (1.6) 
lead to Green’s first and second integral identities: 

A dv 

[ evoao= | uas-| vu-Voan (1.7) 
2 s on re) 
o 0 
i Gs Vn—v Vu) aa= | (u=-»v—) as (1.8) 
n 5 \ On on 


1.3 AUXILIARY CONDITIONS; WELL-POSED PROBLEMS 


The PDEs thai mode! physical systems usually have infinitely many solutions. To select the single 
function that represents the solution to a physical problem, one must impose ceriain auxiliary 
conditions that further characterize the system being modeled. These fall into two categories. 


Boundary conditions. These are conditions that must be satisfied at points on the boundary S of the 
spatial region 2 in which the PDE holds. Special names have been given to three forms of boundary 
conditions: 


Dirichlet condition u=8 


ou 
Neumann (or flux) condition a 
n 
: : ae sxe Ou 
Mixed (or Robin or radiation) condition aut B—=e 
an 


in which g, a, and § are functions prescribed on S. 


Initial conditions. These are conditions that must be satisfied throughout © at the instant when 
consideration of the physical system begins. A typical initial condition prescribes some combination of u 
and its time derivatives. 


The prescribed initial- and boundary-condition functions, together with the coefficient functions 
and any inhomogeneous term in the PDE, are said to comprise the data in the problem modeled by 
the PDE. The solution is said to depend continuously on the data if small changes in the data produce 
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ow, Ow, a Ow, 


divw =V-w= + (1.3) 
Ox oy Oz 
In particular, for w = grad F, we have 
OF OF oF 
div grad F=V-VF=VF =—>+— 5=F,+F +F, (1.4) 
ax’ ay” az ue 


The expression V’F is called the Laplacian of F. 


Theorem 1.1 (Divergence Theorem): Let Q) be a bounded region with piecewise smooth boundary 
surface S. Suppose that any line intersects S in a finite number of points or has a whole 
interval in common with S. Let n = n(x) be the unit outward normal vector to S and let 
w be a vector field that is C' in Q and C° on Q. Then, 


| v-wan=| w-nas (1.5) 
2 Ss 


If w and v are scalar functions that are C? in Q and C' on Q, then the divergence theorem and the 
differential identity 


V-(uVv)=Vu-VotuVvov (1.6) 
lead to Green's first and second integral identities: 
7 ov 
[uy vda= | u—as-| Yu-Yodo (1.7) 
re) s on 2 

0 ou 
| (u Vv — v V2u) an= | (u=- » =) dS (7.8) 

FA 5 on on 


1.3 AUXILIARY CONDITIONS; WELL-POSED PROBLEMS 


The PDEs that model physical systems usually have infinitely many solutions. To sefect the single 
function that represents the solution to a physical problem, one must impose certain auxiliary 
conditions that further characterize the system being modeled. These fall into two categories. 


Boundary conditions. These are conditions that musi be satisfied at points on the boundary S of the 
spatial region 22 in which the PDE holds. Special names have been given to three forms of boundary 
conditions: 


Dirichlet condition u=8§ 


ou 
Neumann (or flux) condition os =g 
FL 


Ou 
Mixed (or Robin or radiation) condition aut B a =g 
qt 


in which g, a, and @ are functions prescribed on S. 


Initial conditions. These are conditions that must be satisfied throughout {2 at the instant when 
consideration of the physical system begins. A typical initial conditton prescribes some combination of u 
and its time derivatives. 


The prescribed initial- and boundary-condition functions, together with the coefficient functions 
and any inhomogeneous term in the PDE, are said to comprise the data in the problem modeled by 
the PDE. The solution is said to depend continuously on the data if small changes in the data produce 
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correspondingly small changes in the solution. The probiem itself is said to be well-posed if (i) a 
solution to the problem exists, (ii) the solution is unique, (iii) the solution depends continuously on 
the data. If any of these conditions is not satisfied, then the problem is said to be ill-posed. 

The auxiliary conditions that, together with a PDE, comprise a well-posed problem must not be 
too many, or the problem will have no solution. They must not be too few, or the solution will not be 
unique. Finally, they must be of the correct type, or the solution will not depend continuously on the 
data. The well-posedness of some common boundary value problems (no initial conditions) and 
initial—boundary value problems is discussed in Chapters 3 and 4. 


Chapter 2 


Classification and Characteristics 


2.1 TYPES OF SECOND-ORDER EQUATIONS 
In the linear PDE of order two in two variables, 
au,, + 2bu,, + cu, + du, + eu, + fu = g (2.1) 


if u,, is formally replaced by e’, u,, by aB, u,, by B’, u, by « and u, by B, then associated with (2.1) 
is a polynomial of degree two in @ and B: 


P(a, B) = aa’ + 2baB + cB? + da + eB+f 


The mathematical properties of the solutions of (2.1) are largely determined by the algebraic properties 
of the polynomial P(a, B). P(@, 8)—and along with it, the PDE (2.1)—is classified as hyperbolic, 
parabolic, or elliptic according as its discriminant, b’— ac, is positive, zero, or negative. Note that the 
type of (2.7) is determined solely by its principal part (the terms involving the highest-order 
derivatives of u) and that the type will generally change with position in the xy-plane unless a, b, and 
c are constants. 


EXAMPLE 2.1 (a) The PDE 3ux. + 2uy + Suyy + xuy = 0 is elliptic, since 
b? - ac = 1?- 3(5)=-14<0 
(b) The Tricomi equation for transonic flow, ux. + yy, = 0, has 
b?- ac =0?-(l)y =—y 


Thus, the equation is elliptic for y > 0, parabolic for y = 0, and hyperbolic for y <0. 


The general linear PDE of order two in n variables has the form 

n A 
Dy) Flys, + 2, bu, + cu = d (2.2) 

ij=t i=1 

If Hog then the principal part of (2.2) can always be arranged so that a, = a,,; thus, the n Xn 
matrix A= [a;| can be assumed symmetric. In linear algebra it ts shown that every real, symmetric 
nXn matrix has n real eigenvalues. These eigenvalues are the {possibly repeated) zeros of an 
nth-degree polynomial in A, det (A— AI, where Uis the n Xn identity matrix. Let P denote the 
number of positive eigenvalues, and Z the number of zero eigenvalues (i.¢., the multiplicity of the 
eigenvalue zero), of the matrix A. Then (2.2) is: 


u 
xj? 


hyperbolic if Z=Oand P=1 or Z=Vand P=n-1 
parabolic if Z>O0 (equivalently, if det A= 0) 
elliptic if Z=Oand P=n or Z=Oand P=0 


ultrahyperbolic if Z=vVandi<P<n-1 


If any of the a,, is nonconstant, the type of (2.2) can vary with position. 


EXAMPLE 2.2 For the PDE 3 xyiy} egxg + AU apg + FU yas = 9, 


3.0 0 d+ a 0 0 
A=|0 1 2 and det} 0 1-A 2 }=(B—A)(A)A—5) 
02 4 0 o° 45% 


Because A = 0 is an eigenvalue, the PDE is parabolic (throughout x;x2x3-space). 
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2.2 CHARACTERISTICS 


The following, seemingly unrelated, questions both naturally lead to a consideration of special 
curves associated with (2.1), called characteristic curves or, simply, characteristics. (1) How can a 
coordinate transformation be used to simplify the principal part of (2.1)? (2) Along what curves is a 


nowledge of u, u,, and u,, together with (2.1), insufficient uniquely to determine u,,, u,,, and u,,? 
To address the first question, suppose a locally invertible change of independent variables, 
| E=46(%y) n=¥sy) (2.3) 


(4,4, — dW, #0), is used to transform the principal part of (2.1) from 
au,, + 2bu,, + cu,, to Au, + 2Bu,, + Cu,, + lower-order terms 

which implies that the principal part of the transformed equation is 

Aug + 2Bu,, + Cu,, 
As found in Problem 2.3, 

A= ab, +2bb,6,+ ch, C= ab, +2bb,b,+ cb, B= adbh, + b(,4, + O,,) + cb,4, 
Since the transformed and original discriminants are related by 
— AC = (b’~ ac)($,4, ~— bu.) 

the type of (2.1) is invariant under an invertible change of independent variables. The principal part 
of the transformed equation will take a particularly simple form if A = C =0, which will be the case 
if @ and w are both solutions of 

az + 2bz,z, + cz, =0 (2.4) 


(2.4) is called the characteristic equation of (2.1); the level curves, z(x, y) = const., of a solution of 
(2.4) are called characteristic curves of (2.1). 

«Turning to question S suppose that u, u,, and u, are known along some curve I’. Then, as 
shown in Problem 2.10, u,, and u,, are uniquely determined along I’ unless 


ady’—2bdx-dy+cdx’ =0 (2.5) 


holds along (i.e., is the ordinary differential equation for) T. 


Uy» 


Theorem 2.1: z(x, y) = const. is a characteristic of (2.1) if and only if z(x, y) = const. is a solution of 
(2.5). 
For the proof, see Problem 2.4. 
Related to the indeterminacy of the second derivatives along a characteristic is the fact that 
physically significant discontinuities in the solution of (2.1) can propagate only along characteristics. 
The number of real solutions of (2.4) or (2.5) is dictated by the sign of the discriminant, 


b°(x, y)- a(x, y)e(x, y) 


Thus, when (2.1) is hyperbolic, parabolic, or elliptic, there are, respectively, two, one, or zero 
characteristics passing through (x, y). In the hyperbolic case, the two families of characteristics define 
natural coordinates (& 7) in which to study (2.1). The absence of characteristics for elliptic equations 
implies that there are no curves along which discontinuities in a solution can propagate; solutions of 
elliptic equations are generally smooth. 


EXAMPLE 2.3 


(a) By Theorem 2.1, the characteristics of the (hyperbolic) one-dimensional wave equation, a7u,. — un = 0, are 
defined by a? dé? — dx? = 0. Thus, the characteristics are the lines 


x+at=&=const. xX ~ at =n = const. 
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(b) The characteristics of the (parabolic) one-dimensional heat equation, 
Kx, — u, = 0 
are defined by « df’ = 0. Thus, the characteristics are the lines 1 = 7 = const. 
(c) Characteristics of the (elliptic) two-dimensional Laplace’s equation, 
Ux + Uy = 0 


must satisfy dy?+ dx?=0, which has no nonzero real solution. Thus, Laplace’s equation has no real 
characteristics. 


For the n-dimensional PDE (2.2), the characteristic surfaces are the level surfaces, 
Z(X%,,X%>,..., X,) = const. 


of the solutions of the characteristic equation 


For n> 2, this characteristic equation cannot generally be reduced to an ordinary differential 
equation as in Theorem 2.1; so, the characteristics are often difficult to determine. As in the case 
n= 2, the characteristics of (2.2) are the surfaces along which discontinuities in derivatives of the 
solution propagate. 


EXAMPLE 2.4 The characteristics of the hyperbolic equation 
U xyxy 7 Wage ~ Uxgxy = 0 (1) 
(a two-dimensional wave equation with x, taking the role of time) are the level surfaces of the solutions of 
2h Zag z= 0 (2) 
By direct substitution it may be verified that 
z= F(x. + x2 sin a + x3C0Os a) (3) 
with F an arbitrary C' function and @ an arbitrary parameter, solves (2). This solution is constant when 
X1 + x2Sin a + x3 COs a = const. 
which may be rewritten as 
(x ~ &1) + (x2 ~ ¥2) sin a + (43— ¥3) cosa =0 (4) 


where (X1, 2, ¥3) is an arbitrary point in x:x2x3-space. Equation (4) represents a one-parameter family of planes, 
each plane containing the point (x1, %2, 3) and making a 45° angle with the positive x;-axis. As is geometrically 
obvious, the family has as its envelope the right circular cone 


(x1 — )Y — (2 — ¥2)?- 05 ~ %3 = 0 (5) 


On the cones (5), a/l solutions (3) are constant; hence, these cones are the characteristic surfaces of (7). 


2.3 CANONICAL FORMS 


We have already seen, in Section 2.2, how a hyperbolic second-order PDE may be simplified by 
choosing the characteristics as the new coordinate curves. In general, if a, b, and c in (2.1) are 
sufficiently smooth functions of x and y, there will always exist a locally one-one coordinate 
transformation, = $(x, y), 7 = w(x, y), which transforms the principal part to the canonical form 


hyperbolic PDE Uz, OF Ug ~ Ut 
parabolic PDE Ure 


elliptic PDE Ugg 


A] 


+ 
4, 7 
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The canonical forms u,,— U,,» 4g, ANG U,, + u,, are the principal parts of the wave, heat, and Laplace 
equations, which serve as prototypes of hyperbolic, parabolic, and elliptic equations, respectively. 
Methods for choosing @ and i to reduce (2.1) to canonical form are illustrated in Problems 2.6—2.9. 

If (2.1), or more generally (2.2), has constant coefficients in its principal part, reduction to a 
canonical form can be accomplished using a linear change of independent variables. Specifically, 
there will exist an invertible linear coordinate transformation, 


ay 


= 3B bx (r=1,2,..., 7") 


i= 1 


that takes (2.2) into an equation with principal part 
pS AU eg 
i=l 


where A, (i= 1,2,...,) are the eigenvalues of the symmetric matrix A. (If A is an eigenvalue of 
multiplicity q> 1, then g of the &-variables will correspond to A.) A rescaling of the independent 
variables, 
fev A, #0 
us g A, = 0 


then yields one of the canonical forms 


hyperbolic PDE Bs spe = Yn; 

parabolic PDE DEM ym, (m=Z>0) 
i=l 

elliptic PDE Bs nn, 
i=1 

ultrahyperbolic PPE =—- Su, — >) Ugg 9 (L<m=P<n-1) 
rat inm+l 


If (2.2). has all coefficients constant and has been reduced to one of the above canonical forms, a 
further simplification is always possible in the elliptic or hyperbolic case (see Problem 2.14) and is 
sometimes possible in the parabolic case (see Problem 2.15). 


2.4 DIMENSIONAL ANALYSIS 


The reduction of a PDE to canonical form does not change the order of the equation or the 
number of independent variables. However, by seeking a solution of a particular form it is often 
possible to reduce the number of independent variables in a problem. 


EXAMPLE 2.5 (a) If we look for oscillatory solutions to the wave equation, 

Uxx + Uyy — We = 0 
of the form u(x, y, f)= v(x, ye“ (i = V~)), then v satisfies the Helmholtz equation, 

Dex + Dyy + k?v = 0 
(6) Traveling-wave solutions to ti. — Us + w= 0, in the form u(x, 1)= v(x—- at) (a=const.), satisfy the ordinary 
differential equation (1— a*)vo" + v = 0. (c) Radially symmetric solutions of Laplace’s equation, us. + uy, = 0, of 
the form 

u(x, y)= v(r) where r= (x? + y?)\? 


satisfy v"+ r7'v’ = 0. 
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Suppose that a physical problem is modeled by a PDE that involves dependent variable u; 


independent variables x,,x,,...,X,; and parameters p,, P2,...,P,,. The general expression for the 
solution of the PDE is 

Fl, £5, Xp, +++) Xo Pis Pav ++ +> Pm) = 9 (2.6) 
which can usually be “solved” to give u = f(x,,..-, X» Pyy +++ Pn)» Consider a fundamental system 


of physical dimensions, each with its corresponding base unit, specifically, consider the International 
System (SI), as indicated in Table 2-1. 


Table 2-1 


Fundamental Dimension Base Unit 


Length (L) meter, m 
Mass (M) kilogram, kg 
Time (T) second, s 
Electric current (A) ampere, A 


Thermodynamic temperature (®) kelvin, K 
Amount of substance (X) mole, mol 


Luminous intensity (1) candela, cd 


d 
Each quantity in (2.6) is either dimensionless (i.e., a pure number) or has as its physical dimension a 
product of powers of the fundamental dimensions of Table 2-1. 


EXAMPLE 2.6 Let F(u, x, t, pc, k)= 0 be the genera! solution of the one-dimensional heat equation 
pcu, — ku,, = 0 (1) 

The dependent variable is the temperature u, while the independent variables and physical parameters are 
xX, =X, X= pi=pec (density times specific heat capacity), and p,=k (thermal conductivity). The physical 
dimensions of these quantities are: 

{u}=@ {x }=L {x2} = T 

{pi} = ML'T-*@"* {po} = MLT?@"! 
There are in al] N = 5 dimensional quantities, which are specified in terms of R = 4 fundamental dimensions (the 
three mechanical dimensions L, 7, M and the thermal dimension @). It happens that only integral powers of the 


fundamental dimensions enter. 
If we define x = k/pc (thermal diffusivity) and rewrite (1) as 


Uy — Kix = 0 (2) 


there are present in (2) one fewer physical parameter and one fewer fundamental dimension ({«x}= L’T~'), 
hence, N— R is unchanged. This invariance reflects the mass independence of the thermal process, and should 
not be expected in general. 


When, as in Example 2.6, a PDE involves fewer fundamental dimensions than dimensional! 
quantities, it must admit a simplified, similarity solution, in accordance with 


Theorem 2.2 (Buckingham Pi Theorem): If (i) the function F in (2.6) is continuously differentiable 
with respect to each argument; (ii) given N — lof the N = 1+ 1+ m quantities u, x,, p, the 
equation (2.6) can be uniquely solved for the remaining quantity, and (iti) u, x, p, 
collectively involve R fundamental units (0< R < WN); then (2.6) is equivalent to 


G(%,, 7, ---5 Typ) = 9 
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where the a, are dimensionless and 
_ YalyValyVa2 ii. Yan py Ya ntl yYant2,.. Ya. N-J 
Wey = UX XX, xX, Py P2 Pin 


for some real numbers y,, (a = 1,2,..., N-R, B=0,1,...,N-1) such that [y,¢] is 
of rank N—-R. 


(For the case R = 0, Theorem 2.2 holds trivially, with G = F.) 


Solved Problems 


2.1 Classify according to type: 
(a) 4, + 2yu,, + xu, —u,+u=0 
(b) 2xyu,, + xu, + yu, = 0 
(c) 4, +u,, +5u,, +u, +2u,,+ u,, =0 
(a) Inthe notation of (2.1), a= 1, b = y, and c = x. Since b?— ac = y’— x, the equation is hyperbolic in 
the region y* > x, parabolic on the curve y* = x, and elliptic in the region y? < x. 


(b) Here, a = 0, b = xy, and c=0. Since b? — ac = x’ y”, which is positive except on the coordinate axes, 
the equation is hyperbolic for all x and y except x =0 or y=0. Along the coordinate axes the 
equation degenerates to first-order and the second-order categories do not apply. 


(c) Rewrite the equation in symmetrical form: 
Uxyey + BU ejay F BU aye, + Uap, + Uaxgeg FU xgxg t Uagay = 0 (7) 


where x; =X, X2= y, X53 = z. The matrix corresponding to the principal part of (7) is 


caw 
A=[3 1 1 


O11 


Since det (A— AI) = (1—A)>— 10(1—A), the eigenvalues of A are 1 and 1+V 10. Thus, 2 = 0 and 
P=3-—1, making the PDE hyperbolic (everywhere). 


2.2 Use the transformation (2.3) to express all the x- and y-derivatives in (2.1) in terms of & and 
7. 
Sy the chain rule, 
Ou du dE du an - 
= + or Ux = Ughy + Unis 
Ox 0& Ax an ax 
and 
due du OE BU AN 
ras or Uy = Uehy + Uy 


dy d& dy dn dy 
By the product rule, 
Ure = Ue Pax + (Ug ex + Unter + (Uy Jae 


which, after using the chain rule to find (ue), and (wu, )x, yields 


10 


2.4 
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Ux, = UePee + (Ugedhs at Ug Wx bx + Uy Prox oe (uneds + Una Ws Wx 
= Ugh + Queg hte + Ung 2+ Ughex + UnWex 
Similarly, 


Uyy = Ugthyy + (Ug yhy + Unyy + (ten yy 
= Ugdhyy + (Uceby + Uenly by + Unbyy + (Unedy + Un ny Py 
= Unchy + Wen dyly + Unnby + UePyy + Unyy 
Finally, 
= Ugbsy + (Ue )yhx + Unbsy + (Un Jobe 
= Urhsy + (Ueehy + Uenby bx + Unihry + (Unehy + Unnifty px 
= UgePrby + gn (Ppy + Gye) + Unnibaby + Ushry + Unbry 


= 
* 
‘ 


Use the results of Problem 2.2 to find the principal part of (2.1) when that equation is written 
in terms of € and ». 


Since Uge, Ue», ANd Uy, Occur only in the transformations of uxx, Usy, ANd Uy, it suffices to transform 
only the principal part of (2.1): 


Uy, + 2buyy + Cuyy = (abs + 2Zhdidy + 663 )Uge 
+ 2adshs + D daly + yx) + ChyWy [Men 
+ (aWz + 2bixthy + CWS gn 
+R 
= Auge + 2Buz, + Cun, + R 


where R = (ad. + 2bdx, + Chyy Ug + (QUicx + 2b, + CHyy Ju, ts first-order in u. Note that R =0 if both @ 
and w are linear functions of x and y. 


Prove Theorem 2.1. 
First assume that z(x, y) satisfies (2.4) and that z,(x, y) #0, so that the relation 
z(% y)= y = const. 
defines at least one single-valued function y = f(x, y). Then, for y = f(x ¥), 


dy _ zn y) 
dx Zy(x, y) 


Dividing each term of (2.4) by z} yields 
BA 2x 
a(=) +2b—+c=0 


which on y = f(x, y) is equivalent to 


dy? d 
a(=) Spee S0 
dx dx 


This shows that y = f(x, y) ts a particular solution of (2.5), and so z(x, y)= y is an implicit solution of 
(2.5). If zy(x, y)=0 but (24) is not identically satisfied, then z,(x, y)#0 and the above argument 
can be repeated with the roles of x and y interchanged. 

To complete the proof, let z(x, y)= const. be a general integral of (2.5). To show that z(x, y) 
satisfies (2.4) at an arbitrary point (x0, yo), let yo= z(Xo, yo) and consider the curve y = f(x, yo). Along 
this curve, 


dy\? dy Ze\? zy 
o= a() - 2 +6=a(=) -26(-=\+< 
ax dx Zy Z5 


from which it follows, upon setting x = xo, that (2.4) holds at (xo, yo). 
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2.5 


2.6 


Classify according to type and determine the characteristics of: 


(a) 2u,,—4u,, — 6u,, + u, = 0 (c) Uy — X°YUyy = 0 (y>0) 
= a 2x xty 2 ee 
(b) 4u,, + Deer 90, 2h nO. . kde age ee, re a = 0 
¢ 
(a) In the notation of (2./) a= 2, b = —2, ¢ = ~6; so b*— ac = 16 and the equation is hyperbolic. From 
Theorem 2.1, the characteristics are determined by 
dy b+VB?-ac 


dx a 


jas 


Thus, the lines x — y = const. and 3x + y = const. are the characteristics of the equation. 


(b) In this case, a=4, b= 6, c=9; so b?- ac =0 and the equation is parabolic. From Theorem 2.1 it 
follows that there is a single family of characteristics, given by 


or 2y — 3x = const. 


(c) In the region y>0, b*- ac = x’y is positive, so that the equation is of hyperbolic type. The 
characteristics are determined by 


d 
—=txVy or = 
dx Vy 


from which it follows that the characteristics are x? +4V/y = const. 


+xdx=0 


(d) b*-ac=(e™*’y — ee?” =0, and the equation is parabolic. Theorem 2.1 implies that the charac- 
teristics are given by 


mak -* dx —e7 dy = 0 
ee or é€ xX—e y= 
dx e” 
from which e-* —e ” = const. 
Transform the hyperbolic equations 
(a) 2u,,—4u,, - 6u,, + u, = 0 (b) u,—x’yu, =0 (y>0) 


to a canonical form with principal part u,,. 


(a) In the notation of Section 2.2, if €= (x, y)=const. and 7 = W(x, y)= const. are independent 
families of characteristics, then A= C=0. In Problem 2.5(a), the characteristics of the given 
equation were shown to be x — y=const. and 3x + y = const. Therefore, we take 


f= $(x%, y)=x-y 7 = Wx, y)=3xty 
Transforming the equation with the aid of Problem 2.3, 
Quix — 4Uxy — OUyy + Uy = 16Ug, + Ug + 3u, 


The desired canonical form is therefore 
1 3 
ug, + ie ug + ie u, =0 
(b) In Problem 2.5(c) the characteristics were found to be x? +4V y =const.; therefore, we take 


E= $(x y)= x? +4Vy n = Wx y)=x?-4Vy 


With , = 2x, $y =2y 7, We = 2%) Wy = —29"?, bax =2= rrr by = YP = ~Yy, and by = 0= 
ty, Problem 2.3 gives 
Ugy — X? YUyy = 16x7 Ug, + (2 + x? y ug + (2- X?y Au, 
6€ +27 2& + 6n 


= 8(E + + 
(E + 7) Uen — ue — 
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where the last equality follows from x? = (+ )/2 and y’” = (€—7)/8. The desired canonical form 
is then 
3+ &+3n 
u 
A(g?— 1?) *  4(é?~ 9?) 


2.7. Transform the parabolic equations 
(a) 4u,, + 12u,,+9u,,—2u,+u=0 (b) e*u,.+ 2e*'u,, + eu, , =0 


to a canonical form with principal part ug. 


(a) In the notation of Section 2.2, C= 0 if y = w(x y) = const. is a characteristic of the equation. Since 
B’— AC = 0, this assignment of 7 will also make B = 0. From Problem 2.5(b), 


9 = W(x, y)= 3x- 2y 
Any (x, y) satisfying dy — dy. #0 can be chosen as the second new variable; a convenient 
choice is the linear function 
f= (4 y)=y 
From Problem 2.3, 
4u,, + 12u,z, + Quy — 2u, + u = Dug — Bu, + 


whence the canonical form 


ca 


1 
Bese 3 8 


(b) In Problem 2.5(d) the characteristics were shown to be e-* — e-” =const., so C= B =0 if we set 


9 = W(x, y)=e*—e” 
A convenient choice for the other new variable is 
f=d(u y)=x 
From Problem 2.3, 
C7 Uy, + 207 xy + OC Uy, = OC Uge + 2, = C*Uge + 2te, 


whence the canonical form ug + 2e7*u, = 0. 


2.8 If (2.1) is elliptic, show how to select @ and w& in (2.3) so that the principal part of the 
transformed equation will be uy, + u,,. 


When b?~ ac <0, (2.5) has complex conjugate solutions for dy/dx, one of which is (f = V—-1) 
dy b+ivV|b?-ac| 
dx a 


(1) 


The ordinary differential equation (1) will have a solution of the form 
z(% y) = }(% y)+ iby, y) = const. 
for real functions @ and y%. Then, by Theorem 2.1, 
0 = az + 2bz,z, + cz} 
= a(be + ie P+ 2b(he + ie (dy + iby) + (dy + tty? 


=[A- C]+2i{B] 
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where the last equality follows from x? = (+ )/2 and y'” = (é — n)/8. The desired canonical form 
is then 
_ Beta oe 
Us ue 
Aan?) AE? = 9") 


u=0 (>) 


2.7. Transform the parabolic equations 
| on. = 2x aty 2y = 
(a) 4u,,+ 12u,,+9u,, —2u,+u=0 (b) -e°ug eu Fen = 0 
to a canonical form with principal part uz, 


(a) In the notation of Section 2.2, C=0 if y = w(x, y)= const. is a characteristic of the equation. Since 
B?— AC = 0, this assignment of 7 will also make B =0. From Problem 2.5(b), 


n= We y)= 3x—2y 


Any (x, y) satisfying dx, — dys #0 can be chosen as the second new variable; a convenient 
choice is the linear function 


f=$(% y)=y 
From Problem 2.3, 
Aug, + 12tay + Quy ~ 2x + U = GUge ~ Bu, + U 
whence the canonical form 


1 
ugg --u, +-u=0 
6 3 in 9 


x 


(b) In Problem 2.5(d) the characteristics were shown to be e* - e-” =const., so C= B = 0 if we set 


n= We y)= ete 


A convenient choice for the other new variable is 
E= (4% y)=x 
From Problem 2.3, 
eu, + 2e** uy + Uy, = OP Uge + 2a, = C™*Uge + 24, 


whence the canonical form ug + 2e7-*%u, = 0. 


2.8 If (2.1) is elliptic, show how to select @ and w in (2.3) so that the principal part of the 
transformed equation will be uy, + u,,. 


When b?- ac <0, (2.5) has complex conjugate solutions for dy/dx, one of which is (f= V—-1) 
dy b+iV|b?= ac| 


dx a 


(1) 


The ordinary differential equation (/) will have a solution of the form 
2(x, y)= &(x, y) + ih, y) = const. 
for rea] functions @ and yw. Then, by Theorem 2.1, 


0= azz+ 2bz,z, + cz3 
= a(gx t if P+ 2b(bx + is )(hy + iy) + C(dy + iy? 
= [(abi + 2bp.dy + ch5)— (api + Waly + co5)| + Zil adsl, + B(hethy + Pye) + chy | 
=[A-C]+2i[B] 
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which holds only if A= C and B= 0. Thus, if we set = (x, y) and 7 = w(x, y), the transformed PDE 


will 


and 


have principal part 


A (ugg + Uny ) 


division by A will yield the required canonical form. 


For the above analysis to be strictly valid, one must require the coefficients a, b,c to be analytic 
functions (see Section 3.1). 


Using Problem 2.8, transform the elliptic equations 


(a) a ,+24,, + 17u,,=0 (o) x°u+ yu, =0 (x>0,y>0) 


to canonical form with principal part ug, + u,,- 


(a) 


(6) 


Here, a= 1, b=1, and c = 17; (1) of Problem 2.8 becomes 
d 
alae Sy 
ax 


which has the solution z = (x — y)+ i4x = const. Thus, setting 
f= (4 y)=x-y n = p(x, y)= 4x 
we obtain, as in Problem 2.3, 
Ux, + 2ugy + 17 uy, = 16uge+ 16U,, 


whence the canonical form ug + U,, = 0 (Lapiace’s equation). 


In this case, (1) of Problem 2.8 becomes 


By te). 
dx x 
with solution z = log x + i log y = const. Setting 
&= P(x) = log x 7 = w(y)= logy 


we calculate, following Problem 2.3, 
Rtg YUyy = Ugg + Ugn — Ug — U, = 0 


as the required canonical form. 


Show that a characteristic curve of (2.1) is an exceptional curve in the sense that the values of 
u, u,, and u, along the curve, together with the PDE, do not uniquely determine the values of 


u 


XX? 


u,,, and u,, along the curve. 


Let T be a smooth curve in the xy-plane, given parametrically by x = x(s), y= y(s), si<s <5. 
Suppose u, u,, and wy are specified along T as u = F(s), ux = G(s), and uy = H{s). Then, 


du, 
ds 


duy : i ; 
ae = bbyX'(S)+ byyy'(s) = H"(s) 


= UyxX'(S) + tayy'(s) = G(s) 


These two equations and (2.1) comprise three linear equations, which may be solved uniquely for the 
three unknowns ux, Uy, and uy, along I’, unless the coefficient matrix 


a 2b c 
x(s) y(s) 0 
O xs) y(s) 
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has determinant zero; that is, unless 


dy\? dx dy dx\? 
a( ) 26 +e ) =0 
ds ds ds ds 


This last equation is equivalent to (2.5), which defines the characteristics of (2.1). 


If the variables &,, &,...,&, and x,, %,,..., x, are related by the linear transformation 
n 
€=B'x or pS x (r= 1,2,...,n) 
1 


change (2.2) to the &-variables. 


According to the chain rule, 


due Su BE, OS ou 
uy, = iz = ir 


OX, pei OL, OX; a1 0€, 
n dé, n n e7u 
U sic; = Une — = bys (Ux eg = birbjs > 
} 2, ios, > eas 2, ” A€,dE. 
Thus, in terms of &1, 2,..., &n, (2.2) is 


n 


> > birdibye bes > [> bbs |e+ cu=d 


rs=al bijml r=l ie 


Crs 


If (2.2) has constant coefficients a,, show that it is possible to choose matrix B in Problem 2.11 
such that no mixed partials with respect to the £-variables occur in the transformed equation. 


From Problem 2.11 it is seen that the matrix C defining the principal part of (2.2) tn the é-variables 
is given by 
C= BAB 


According to the following result from linear algebra, B can be chosen to make C a diagonal matnx 
(Gs = 0 for r# s), thereby removing all mixed partials from the transformed PDE. 


Theorem 2.3: Let A be a real, symmetric matrix. Then there exists an orthogonal matrix B such that 
C = B’ ABis diagonal. Moreover, the columns of B are the normalized eigenvectors of A and 
the diagonal entries of C are the corresponding eigenvalues of A. 


(B is orthogonal if B? = B™'. It can be shown that to an m-fold eigenvalue of A there correspond precisely 
m linearly independent eigenvectors.) 


Find an orthogonal change of coordinates that eliminates the mixed partial derivatives from 


a rey 12u, ,, 12u, = 0 


Then rescale to put the equation in canonical form. 


2u,, + 2u,. — isu, 


The matrix corresponding to the principal part of this equation is 


2 4 -6 
A=| 4 2 -6 
-6 -6 ~15 


From 


det (A— AI) = A3 + 1142 ~ 144A — 324 = (A + 2)(A + 18)(A — 9) 
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it follows that the eigenvalues of A are A; 2, A2=—18, Az = 9. According to Theorem 2.3, the rth 


column-vector of the diagonalizing matrix B, 
b, = (51, bo, b3,)" 
satisfies (A— A,Db, = 0, or 


(2—A,)bi- + Abo, — 6bs, = 0 
4b,,+ (2- A,) ba, — 663, = 0 
—66,,- 6b2,+ (-15— A,)b3, = 0 


together with the normalizing condition 
b, +b, = bi, + b3,+ b3,=1 


For r= 1, Ay= —2, (Z) implies by, = —b21 and b3; = 0; then (2) is satisfied if 


by = by = b3; = 0 
For r = 2, A2= —18, and 4,2 = 4622 = 632; normalizing, 
en ae ee el 
3V2 3V2 
For r = 3, As = 9, and b)3 = by = —2633; normalizing, 
hea pge® 
3 3 


With B determined, the change of variables & = B7x transforms the given equation to 


~2u ee — Suge t PU ge = 9 


(1) 


(2) 


Finally, by defining m= &/Vv2, n2 = €2/(3V2) and n3= 43/3, and multiplying the equation by —1, we 


obtain 
Uning ~ Anon, Ungny = 0 


which is the canonical form for a hyperbolic PDE in three variables. 


Find a change of dependent variable which eliminates the lower-order derivatives from 


u Hig FOR, — LA, + 8u,.= 


ss} Te Kon — X33 


If u(y, x2, x3) = v(x1, X2, x3)exp (ZF. cix:), then 


3 
Uy; = (Vx, + Cv)exp (> ax) 


fal 


Je 


CX; ) 


2 
U six) = (V xix; + 2¢02,+ civ)exp ( 


_ 


t= 


and the PDE for v is 
Vapey + Vagxy — Vagry + (64 201)04, + (- 144 2eQ)0 yt (8+ 2¢3)0.4t (ci + c3- c3)v =0 
Now choose c, = —3, ¢2=7, and ¢c3 = —4, to produce 


Vypey T Vag 7 Vga + 420 = 0 


Find a change of dependent variable that reduces the parabolic PDE 
u,, + 4u,-— 2u,t+ 8u=0 


to the one-dimensional heat equation. 
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If we set u(x, t) = u(x, Hexp (cof + c.x), then the PDE for v is 
Dye + (44 2e,)vy — 20, + (8 + oF + cov =0 


Setting c, = ~2 and cg = — 12 we have v,, — 2v, = 0, a homogeneous heat equation with thermal diffusivity 
Kk = 1/2. 


2.16 Refer to Example 2.6. Apply Theorem 2.2 to the initial-boundary value problem 


u,— Ku, = 0 for x >0,£>0 
u(0, t)=0 for t>0 
u(x, 0) = uy for x >0 


obtaining two dimensionless groups, and then find a differential equation relating these 
groups. 
The initial condition has added one parameter to (2) of Example 2.6, without increasing the number 


of fundamental! dimensions involved ({uo} = @). Thus, N =5 and R =3 in the Buckingham Pi Theorem, 
which guarantees a solution G(a1, 772) = 0, with 


b= {ra} = {uc} "O{} 240) fac} 940)" 
= @ 0] va! TLV? T 1) Yaa 


= Lvalt2ya3 T7227 Ya3@ Yat Yo 


To make the exponents vanish, choose, for a = 1, yio= ¥yia =O and yu = 1; then yr = y13 = — 1/2. The 
dimensionless group 


is known as the Boltzmann variable or similarity variable for the one-dimensional heat equation. For 
a = 2, choose ya = 1, yaa = —1, and ya. = yr = ¥23 = 0, to obtain 


i? 
Uo 


Assuming that G.(71, 72) #0, we can rewrite our solution as 72= g(a) or u= uo g(a). It then 
follows from the chain rule that 


Qu " ee 1 "( — 
Rae ere enh eee pas 
at a a daa 
OM og! ms) = tn "(1 — 
— = Uo B’(71) — = uwog'(m 

Ox Ox Vk«t 
cay) 2 


( (=) ( ) 1 
—> = uo 8"(m1) {| —— | = up g"(7,) — 
x? BE ae ee 
The PDE u, — xu,, = 0 now implies the following ordinary differential equation for 72 as a function of Ty: 


g"(m) + Fem) =0 (1) 


2.17 Derive the similarity solution 


u(x, t) = uy erf ( 


val 


for the initial-boundary value problem of Problem 2.16. The error function, erf z, is defined by 
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2.18 


2.19 


2.20 


2.21 


es [ ~* ds 
erfz= e 
VT “6 


Integrate (1) of Problem 2.16 once with respect to 7 to find 


2 


WT 
log |g’(ar1)| + ms = const. or g'(mm) = (const.) e774 


Integrate again and fix g(0)=0 to make u(0, t) = 0: 


myi2 


7 
g(m) = (const.) [ e~’** dr = (const.) [ e~* ds = (const.) erf (71/2) 
oO oO 
Since lim,..erf z = 1, the last constant should be set to unity, ensuring 


lim u(x, t)= uo lim g(m) = uo for x >0 


107 my +00 


This gives the required similarity solution. 


Introduce dimensionless dependent and independent variables that transform the heat equa- 
tion u,— Ku,, = 0 to the dimensionless form v, — v,, = 0. 


The dimensions of x, 4 4, and « are: 


{x}=L {h= 7 {u}=0 {x}= UT 


Choose dimensionless variables € = x/xo, 7 = t/to, v = u/uo; the PDE becomes 


Vo Uo K 

— Up — K > Ve = 0 or Dy — Ty Vee = 0 

fo x6 xbto' 
The coefficient of vge is seen to be dimensionless. Therefore, by proper choice of x9 and &, it can be 
made equal to unity, yielding the desired dimensionless equation. Note that this equation involves no 
fewer variables than did the original equation: neither € nor r is the dimensionless Boltzmann variable of 


Problem 2.16. 


Supplementary Problems 


Describe the regions where the equation is hyperbolic (h.), parabolic (p.), and elliptic (e.). 


(@) Uy — Uy — 2tyy, = 0 (€) Yur — 2Uy + e* Uy tu =3 
(b) wx + 2, + uy =0 Cf) eux + (sinh x)u,, + u = 0 
(c) 2x + 4uxy + 3u,, — Su =0 (g) Xt, + 2xyuy, — yuy, = 0 
(d) tex + 2X, + Uyy + (COS XY )Ux = U (h) Xt, + 2xyuay + yyy = 0 


Show that for (2.2) to be of ultrahyperbolic type, there must be at least four independent variables. 


Let p = p(x, y) be positive and continuously differentiable. Write out the principal part and classify the 
equation: 


(a) Vi(pVu)+qu=f (b) u-V-(pVu)+qu=f (c) use-Vi(pVu)+qut+mu=f 
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2.22 


2.27 


2.28 


2.29 


2.30 


2.31 


2.32 


2.33 
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Find the characteristic curves for the given equation. 


(a4) Ue —uy+u=0 (€) Ua yyy =0 

(6) 3u,. + 8, + 4u,, = Cf) yt, — 2xyuy, + x2, + yu, + xu, = 0 
(c) bx — by + u, + wu =0 (g) yeux + by =0 

(d) ust uy =0 (h) Yue + wy = 0 


Show that 5u,. + 4u,, + 4u,, = 0 is elliptic and use a transformation of independent variables to put it in 
canonical form. 

Show that Beh ayy — 2U yey + 2U xgxy — 2U xpey + BU gy + 124, - 84, = 0 

is elliptic and use a linear change of coordinates to transform its principal part to 


Hee + 3Uoe t+ 4 ge 
By rescaling the é-variables in Problem 2.24, transform the principal part to V7u. 


(a) Determine the type of the equation 
Buby, t+ 2b x92 + BU yxy t 2U yxy = 0 

and (8) use Theorem 2.3 to reduce it to canonical form. 
Verify that the given equation is hyperbolic and then find a change of coordinates that reduces it to 
canonical! form. 

(@) uxt 2iny ~ Buy +tu,t+5=0 (d) eu, + 2e*uyy — e?* uy, = 0 

(b) ux + 2(xt+d)uy + 2xu,, =0 (e) (+x?Pu.—-(A+ yu, =0 

(c) 24. +4uy — wy =0 


Classify the given equation and then find a change of coordinates that puts it in canonical form. 


(a) u,+01+x*Pu, =0 (i) uy + xyuy =0 

(6) 4uu.- 4u, + Su, =0 (U) Vikx — XUyy + Uy + yu, = 0 

(c) uy. —2u, + wy, =0 (k) eu, + 2e** uy + ey =0 

(2) Ux-Wytutut2xty=5 QQ) u.tU+yVPuy =0 

(€) x7 uy, + 2xytay + y*Uyy = 4y? (m) XU t2V XY Uy t Yuyy— uy =O (x>0, y>0) 
(f) x? tx — y7ubyy = xy (n) (sin? x)u,, + 2(cos x)uxy — Uy = 0 

(g) (x?tux)s — yy = 0 (0) ex — X7 Uy — Ux = 0 


(A) y°Uex — 2YUsy + Uyy — Uy — BY = 0 (p) (1+ x°Pue — 20+ x7)\(1+ yu + (1+ y?Puyy = 0 


Use the results of Problem 2.3 to show that 
B’- AC= (b? = ac) (dxihy = dye y 


Show that if (2.1) is hyperbolic and in (2.3) @ and w are chosen to make A and C, the coefficients Of ugg 
and u,,, zero, then 2B, the coefficient of ug, is not zero. 


Show that GX? Uz, + Zhxytyy + cy* uy, + dxu, + eyu, + fu = g (a,...,f constants) 


is transformed into a constant-coefficient equation under & = log x, 7 = log y. 


Show that the two canonical forms for the wave equation, ug, and Uae — Uga, are related by a 45° rotation 
of coordinates. 


Use a change of dependent variable to reduce u,,. — u, + 4u, + 6u = 0 to the heat equation, v,, — v, = 0. 


Chapter 3 


Qualitative Behavior of 
Solutions to Elliptic Equations 


3.1 HARMONIC FUNCTIONS 


Because the canonical example of an elliptic PDE is Laplace’s equation, V’u = 0, we begin with 
the following 


Definition: A function u= u(x) is harmonic in an open region, ©, if u is twice continuously 
differentiable in 0 and satisfies Laplace’s equation in Q. u is harmonic in Q, the closure of 
Q, if uw is harmonic in 0 and continuous in 2. 


EXAMPLE 3.1 
(a) u(x, y)=x?— y* is harmonic in any region © of the xy-plane. 
(b) u(x, y, z)= (x? + y? + z7)"'? is harmonic in any three-dimensional region which does not contain the origin. 


If © denotes the ball of radius one centered at (1, 0,0), then u is harmonic in 2 but not in Q. 


Let x, be a point in © and let B,(x)) denote the open ball having center x, and radius R. Let 
Xp (X,) denote the boundary of Bz (x,) and let A(R) be the area of 2p (Xp). 


EXAMPLE 3.2 Using calculus methods, one can show that in R” the volume, V,(R), and the surface area, 
A, (R), of any ball of radius R are given by 


na? 
(nD! R"™ (n even) 
= n{2)! 
A, (R)= ”2R7'V,(R)= On (Qa)? 7 (1) 
—————. R" (n odd) 
1 -3- 5 rs | 
Definition: A function « has the mean-value property at a point x, in 0 if 
1 
u(x, == | u(x) d> (3.1 
0. A(R) - R ) 


for every R >0 such that B, (x) is contained in 0. 


Theorem 3.1; u is harmonic in an open region Q if and only if uw has the mean-value property at 
each x, in @. 

By Theorem 3.1, the state function, u(x), for a physical system modeled by Laplace’s equation is 
balanced throughout © in the sense that the value of u at any point x, is equal to the average of u 
taken over the surface of any ball in 0 centered at x). In other words, Laplace’s equation—and 
elliptic PDEs in general—are descriptive of physical systems in the equilibrium or steady siate. 


Theorem 3.2: Let Q be a bounded region with boundary S and let u be harmonic in Q. If M and m 
are, respectively, the maximum and minimum values of u(x) for x on S, then (Weak 
Maximum-Minimum Principle) 


m <u(x)=M_ for all x inQ 

or, more precisely (Strong Maximum-Minimum Principle), 
either om<u(x)<M_ forallxinQ 
orelse m=u(x)=M_ forallxingd 
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EXAMPLE 3.3 If 0 is not bounded, then the (weak) maximum-minimum principle need not hold. In fact, 
u(x, y) = e* sin y 


satisfies Laplace’s equation in 0 = {(x, y): -~<x <0, 0<y< a}, and u is zero on the boundary of ©, so that 
m= M=0. But u(x, y) is not identically zero in 0. 


Definition: A function u(x) is analytic in Q if u is in C°(Q) and, in a neighborhood of each point x 
in ©, u equals its Taylor series expansion about x. 


Theorem 3.3: If u is harmonic in a region Q, then uw is analytic in 2. 


Theorem 3.3 implies that solutions of Laplace’s equation cannot exhibit discontinuities in the value 
of u or of any of its derivatives. This is again characteristic of a physical system in the steady state (any 
initial disturbances having been smoothed out). 

There is a strong connection between harmonic functions in the plane and analytic functions of a 
complex variable. This connection provides a partial converse to Theorem 3.3. 


Theorem 3.4: lf f(z)=f(x + iy) = u(y y) + iv, y) is an analytic function of the complex variable z 
in QO, then u and v are harmonic in 0. 


Theorem 3.5: A function u(x, y) is harmonic in a simply connected region if and only if, in QO, u 
is the real part of some analytic function f(z). 


EXAMPLE 3.4 If f(z)= z7= (x+iyy = x?—- y?+i2xy, then 
u(x, y) = Re f(z) = x?- y? and v(x, y) = Re -if(z) = 2xy 


each satisfy Laplace’s equation in the plane. 


3.2. EXTENDED MAXUMUM-MINIMUM PRINCIPLES 


Definition: A continuous function u is subharmonic in a region © if, for every x, in ©, U(X) is less 
than or equal to the average of the u-values on the boundary of any ball, B,(x,), in Q: 


1 


u(Xy) = A(R) 
ZR 


u(x) dd, (3.2) 


A superharmonic function satisfies (3.2) with the inequality reversed; it is thus the negative of a 
subharmonic function. 

If u is C’, then u is subharmonic if and only if V’u =0, and u is superharmonic if and only if 
V’u <0. Clearly, a harmonic function is both subharmonic and superharmonic, and conversely. The 
maximum-minimum principle, Theorem 3.2, extends to subharmonic and superharmonic functions, as 
follows: 


Théorem 3.6: For 0, S, m, and M as in Theorem 3.2, 
(i) if V’u =0 in O, then u(x) <M for all x in Q or else u(x) =M in O, 
(ii) if V?u <0 in QO, then u(x)> m for all x in 2 or else u(x) =m in 0. 
Results similar to Theorem 3.6 hold for elliptic equations more general than Laplace’s equation. 


Definition: The linear operator 


LU => a0) + 5 0,0) ++ eww 7) 


i a 


is uniformly elliptic in Q if there exists a positive constant A such that 
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n 


DX a, (x)o,b, 2A > ie (3.4) 


if=l 
for all (¢;, €,---, &,) in R® and all x in Q. 
Observe that, if (3.4) holds, matrix A(x) must be positive definite in Q, which means that L[ ] ts 


elliptic in Q, with Z=0O and P=n (Section 2.1). On the other hand, assuming that an elliptic 
operator has all eigenvalues positive (if all are negative, multiply the operator by —1), we have 


Theorem 3.7: If L[ ] is elliptic in Q., it is uniformly elliptic in Q (a-fortiori, in Q). 
Theorem 3.8: Let ©, S, m, and M be as in Theorem 3.2. Suppose in (3.3) that c=0, L[ | is 
uniformly elliptic in Q, and a, and b, are continuous in 0. 
(i) If L[u] =O in O, then u(x)< M for all x in O or else u(x) =M in . 
(ii) If L[u] <0 in Q, then u(x) > m for all x in Q or else u(x) =m in 0. 
(iii) If L[u] = 0 in Q, then m < u(x) <M for all x in 0 or else m= u(x)=M in 
Q. 


Theorem 3.9: Let 2 be a bounded region with boundary S. Suppose that u(x) satisfies L[u] = f in 
, where L[ ] is uniformly elliptic in Q and has coefficients a@,, b, c which are 
continuous in 2. Suppose further that, in 0, c $0 and f is continuous. 

(i) If f<0 in M and u(x) is nonconstant, then any negative minimum of u(x) 
must occur on § and not in 2. 

(ii) lf f=0 in 2 and u(x) is nonconstant, then any positive maximum of u(x) 
must occur on S and not in 9. 


Theorem 3,10: In the boundary value problem Li[u]=f in Q, u=g on S, suppose that the 

hypotheses of Theorem 3.9 hold and that g is continuous on S. Let |a,,|, |;|, |c| all be 
bounded by the constant K, and let A be as in (3.4). If uw is C? in Q and C° in Q and 
if u satisfies the boundary value problem, then, for all x, in Q, 


Ve tp) Mas 1g 00) FM ax F(x)! 


where M = M(A, K). 


33 ELLIPTIC BOUNDARY VALUE PROBLEMS 


Since elliptic equations in general model physical systems that are not changing with time, the 
associated auxiliary conditions are typically boundary conditions (Section 1.3). 


EXAMPLE 3.5 If Q is the region 0<x<1,0< y <1, then the boundary value problem 


Lx, + Uy = f(x, y) mo 
u(x, 0) = u(x, 1) = 0 on0<x<1 
u, (0, y)= 1 ond<y<1 
2yu(l, y)- Su, y)=y?> on 0<y<1 


has a homogeneous Dirichlet condition on the portion of the boundary where y=0 or y= 1. A Neumann 
condition holds on the part of the boundary where x = 0. On the edge x = 1, u satisfies a mixed condition. 


A classical solution of a (elliptic) boundary value problem satisfies the PDE L[u] = f in Q, is C* 
in Q, and is C° in Q (for a Dirichlet condition on $) or C' in Q (for a Neumann or mixed condition 
on'S). It is possible to relax somewhat the smoothness conditions; such weak solutions are discussed 
briefly in Chapter 5. When no qualifier is used, a solution is understood to be a classical solution. 
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If the region 2 is unbounded, then, in addition to the boundary conditions, a solution is generally 
required to satisfy a condition at infinity, which is frequently dimension dependent. 


EXAMPLE 3.6 
(a) If {is the half-plane y > 0, then, in the boundary value problem 


Uxx + Uyy = f(x, y) inQd 
u(x, 9) = g(x) on S 


the usual condition at infinity is that u« be bounded, 
|u(x, y)| <M = const. 
for x7 + y?> 0%, y >0. 
(b) If 0 is the half-space z >0, then, in the boundary value problem 
Uxy + Uyy + Uz = f(x, y, Z) ing 
u(x, y, 9) = g(% y) on S 
the typical condition is that u vanish at infinity, 
|u(x, y, z)| > 0 
for x7+ y?+ z?+0, z>0, 
The three conditions for a well-posed problem were stated in Section 1.3. For many elliptic 
boundary value problems, maximum-minimum principles like Theorems 3.8~-3.10 or an energy- 


integral argument can be used to show that conditions (ii) (uniqueness) and (iii) (continuous 
dependence on data) hold. See Problem 3.14. 


EXAMPLE 3.7 Let 2 be a bounded region. The Dirichlet boundary value problem 
Vu=f inQh 
u=g on S$ 
* the Neumann problem (c¢ <0) 
Vutcu=f ing 


Ou Ss 
—= on 
on e 
and the mixed problem (af > 0) 
Vu=f inn 


Ou 
au+B—=g on $ 
on 
each have at most one solution and each solution depends continuously on the data functions f and g. Nonetheless, 
there are mathematically and physically significant elliptic boundary value problems that are iil-posed with 
regard to conditions (ii) and (iii). 


Condition (i), the existence of a solution to a boundary value problem, is generally more difficult 
to establish. The most satisfactory way to show that a solution exists is to construct it; the solutions to 
a number of elliptic boundary value problems are constructed in Chapters 7 and 8. A particularly 
important constructive existence result, for Laplace’s equation, is given by 


Theorem 3.11 (Poisson’s Integral Formula): In R’, if g(&) is continuous on %,: |—|/=R and 
A,, (1)—see (1) of Example 3.2—is the area of the unit sphere, then 
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R? = |x/? g(&) 
u(x) =} RA, (1) Sp baer 
a(x) |x| =R 


dX. Ix} < R 
(3.5) 


is a solution to the boundary value problem 
Vu=0 in|xi<R 
u=g on|x|=R 


See Problems 8.7 and 8.38 for a derivation of (3.5). Observe that for x = 0, (3.5) coincides with (3. /), the 
mean-value property. 

Sometimes, the nonexistence of a solution to a boundary value problem may be demonstrated 
immediately, ; 


EXAMPLE 3.8 For the Neumann problem 


Vu=f in Q 
ou s 
—_= on 
on 2 


It follows from the divergence theorem that 


ou 
| san=] Vudn= | —dS=| gdS 
a a s On s 


Thus, if the consistency condition fa fdQ. = Ss g dS is not satisfied, the Neurnann problem cannot have a solution. 
Problem 3.20 gives a consistency condition for an elliptic mixed problem. 


Solved Problems 


3.1 Show that if uw is harmonic in an open region © of R’, then u has the mean-value property in Q. 


Suppose that 2 includes the ball B,(x%o) for O<p <= R, By the divergence theorem, 


Ou 
0= Vu dB, = | — a=, (1) 
Bp Xp or 
in which we have introduced the radial coordinate r = |E ~ xo; — being a general point of R”. Now, 
u(r, ...)| du(p,...) 
or 1p 6p 
and (see Example 3.2) d, = p""' d&,, where =, denotes the surface of the unit sphere. Therefore, (1) 
implies 
Ou - d % 
0= ~ a3.-—([ ud, ) (2) 
x, OP dp \Js, 


Integration of (2) from p =0 to p= R, where R = |x — xol, yields 
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3.3 
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0 = u(x) a3.- | u(Xo) dZ1 


= =) 


=| u(x) dX pz — u(xo) A, (1) 
R™! Sp i is 


1 
= A, (1) I—> u(x) dz — u(x )| (3) 
MARY Ip i 
since, from Example 3.2, A,(R) = A,(1)R”?. The mean-value property of u follows at once. 
The converse theorem, that the mean-value property implies harmonicity, can be proved by 
reversing the above argument if the prior assumption is made that u is in C?(Q). A way around such an 
assumption is shown in Problems 3,2-3.4. 


Suppose that u has the mean-value property in the bal] B,(x,). If us M in B, and u(x,) = M, 
show that u = M everywhere in Bp. 


From the mean-value property and the given conditions on u, 


1 
M = u(xo)=—— | u(x) di,=M 1 
* A(r) Je, o 
for r= R. As equality must hold throughout (/), u(x) = M at every point of ,. Thus, u(x) = M for all x 
in Br (Xo). 


Suppose that u has the mean-value property in a bounded region Q and that u is continuous 
in Q. Show that if uw is nonconstant in ©, then u attains its maximum and minimum values on 
the boundary of Q, not in the interior of Q. 


Since u is continuous in the closed, bounded region Q, u attains its maximum, M, and its minimum, 
m, somewhere in ©. We will show that if uw attains its maximum at an interior point of Q, then wu is 
constant in 9. 

Assume that u(xo) = M, with xo in Q, and Jet x* be any other point in Q. Let [ be a polygonal path 


in Q joining Xo and x* and let d be the minimum distance separating [ and 5, the boundary of !2: 
d = min {|x—y/:x on I, y on S} 


There exists a sequence of balls Br(x;), i=0,1,..., n, with x; on T, satisfying R Sd, xj4, in Ba(x,), x* in 
Br(x,). See Fig. 3-1. 


Fig. 3-1 
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3.4 


3.5 


3.7 


Problem 3.2 shows that uw is identically equal to M in each Br(x;), i=0,1,..., 2; hence, u(x*) = M. 
Since x* was arbitrary, wu must be equal to M throughout { and, by continuity of u, throughout ©. This 
shows that if u is not a constant in (, then u can attain its maximum value only on the boundary of 2. 

The above argument, applied to —u, establishes that if uw is nonconstant, if can attain its mintmum 
value only on S. 


Show that 1f uw has the mean-value property in an open region Q, then uw is harmonic in Q. 


Let xo be any point in 2, and let Bg(xo) be wholly contained in Q. Since Laplace’s equation is 
invariant under a translation of coordinates, we shall suppose xo = 0. If v is defined in Bg(0) by Poisson's 
integral formula, (3.5), with v = u on the boundary of Br, then, by Theorem 3.11, v ts harmonic in Br. 
By Problem 3.1, v has the mean-value property in Br. Because both u and v have the mean-value 
property in Ba, w=u-—v has the mean-value property in Bg. Since w=0 on the boundary of Br, 
Problem 3.3 shows that w =0 throughout Br. Thus, u is identically equal to the harmonic function v in 
Ba, and so u is harmonic at 0, which, from the above, represents any point in Q. 

The above proof has an important implication: Any harmonic function can be expressed in terms of 
its boundary values on a sphere by Poisson’s formula. Equivalently: The Dirichlet problem 


Veu=0 in|xj<R 
has a unique solution. 


Establish the maximum-minimum principle for harmonic functions, Theorem 3.2. 


Problem 3.3 establishes Theorem 3.2 for functions having the mean-value property. But, by 
Problems 3.1 and 3.4, these functions are exactly the harmonic functions. 


Show that if u(x, y) is subharmonic, V’u=0, in a bounded region Q and u=M on S, the 
boundary of O, then u <M everywhere in 1. 


Since 1) is bounded, it can be enclosed in a circle, of radius R, centered at the origin. Let e >( be 
arbitrary and define 


v(x, y) = us, y)t+ e(x? + y’) in? (1) 
From (1), 
Wu =Wut2e>0 in 2D (2) 


v can attain a maximum in Q only on S; for, at an interior maximum, v,, <0 and v,, =0, which would 
contradict (2). From uM on S, it follows that v= M+ €R* on S and, since v attains its maximum on 
S, v= M+ eR? everywhere in 2. By (1), u<v; so 

uxM+ eR? in (3) 


for any € > 0. It follows that u cannot exceed M in QO); if it did, then, for sufficiently small «©, (3) would be 
violated. 

The above argument provides an alternate proof that a harmonic function on a bounded region 0 
must attain its maximum on the boundary of N. 


Show that if u(x, y) is harmonic in a bounded region Q and u is continuously differentiable in 
Q, then |Vu)’ attains its maximum on S, the boundary of 2. 


Let w =|Vul = u2+ u2. Since u is C' in Q, w is continuous on S. Therefore, since S is closed and 
bounded, there is a value M assumed by w on S$ such that 


w=M  onS (1) 
Calculating V?w = V- Vw, we find 
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= at iyid 2 2 2 
Ww = 2(uplerr + U2, + Uytary + Uy + Uxthyy + Uy + Wylyyy + Uy) 
Since u is harmonic in N, wx. + uw, = 6 in O, and 
UxUere + Uyleyy = Ux (Uxx + Uyy)x = 0 
Uylbery + Uylyyy = Uy(Uxx + Uyy)y = 0 


Thus, 


Ww = u2,+2u2,+ 42,20 int (2) 


or w ig subharmonic in 2. Problem 3.6 and (1) now imply that w = |Vuf'=_M throughout 9. 
This result has a number of interesting physical interpretations; e.g., for steady-state heat flow in a 
homogeneous medium £2, the heat flux vector of maximum magnitude must occur on the boundary of 0. 


3.8 Show that the solution to the Dirichlet problem indicated in Fig. 3-2 satisfies 


0< u(x, y)<x(2- x-2y) 


in). 


0, 0}. “= x(2—x) (2, 0) x 


Fig. 3-2 


Let v(x, y) = x(2— x ~—2y) and note that V?v = —2 in 2. Then, if 
w(x, y) = ulx, y)— v(% y) 
in 9, we have 
Vw =2>0 ina 
w=0 ons 
From Theorem 3.6(i), w(x, y) <0 in Q; that is, 
u(x, y)< v(x, y)= x(2—-x-2y) inQ. 


Since the minimum of u on S is zero, it follows from Theorem 3.6(i) that u(x, y)>0 in 9. 


3.9 Let u(x, y) be continuous in the closure of a bounded planar region © and let the linear 
operator 
Llu) =u, +u,, + bi(x, y)u, + B(x, yu, 


be defined in 2, in which 5, and b, are continuous functions. Prove: (a) If u(x, y) satisfies 
L{u] =f in Q, with f>0, then u attains its maximum on S, the boundary of 2, not inside ©. 
(b) If u(x, y) satisfies Liu] =0 in O, and if u=M on S, then uS=M in 0). 
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Since u is continuous in the closed bounded region Q), it must attain its maximum, M, somewhere in 
Q. Let (xo, yo) be an interior point of and assume that u(x, yo) = M. From calculus, u, = 0= uy, 
Ux =0, and wy <0, at (Xo, yo); hence, b,; and bz being bounded at (%, yo), 


L[u] = tx + Uyy =O 
which contradicts L[u] = f >0. We must, then, admit that the maximum is achieved on S. 
Because b, is bounded (below) in Q, there exists a constant @ such that 
L[e**] = ae*(a +b) >0 inQ () 


For arbitrary « > 0, define »v =u + ee. Let R be chosen large enough so that the circle centered at 
the origin with radius R encloses 0. Since u=M on S, 


v=M+ eer® on S$ (2) 
From L(u)= 0 and (1), L[v] > 0. It now follows from the result of (a) that 


u<v=M + eer? in Q (3) 


for arbitrary « > 0, and this implies that u<M in Q. 


Under the hypotheses of Problem 3.9, with 6, and b, assumed continuous in Q, show that a 
solution of L[u] = 0 cannot attain its maximum, M, at an interior point of © unless u=M in 


Q. 


Let M denote the maximum of u on Q and suppose that u assumes the value M somewhere in Q. If 


u#M in Q, there exists a disk B, in Q that contains on its boundary an interior point (é, 7) of © where 
u(é, 7) = M and such that u(x, y)<M inside B,. Let By be a disk of radius R satisfying B,C B,, with 
the boundary of B, tangent to the boundary of B, at (€, 7); i-e., 1 A 22 = (€ 7). (See Fig. 3-3.) Since the 


PDE L[u] = 0 is invariant under a translation of coordinates, the origin can be taken to be the center of 


B,. Let By be a disk in 0 centered at (€ 7), of radius less than R. Divide the boundary, 23, of Bs into the 
two arcs 


o=3sN B, O2=23- 07 


Fig. 3-3 
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By hypothesis u is continuous on the closed are a1, at every point of which u <M (because o; C By). It 
follows that u is bounded away from M on ay: 
u(x, y)=M-€ for some €)> 0 and all (x, y) on a (1) 
Define the comparison function 
—ar2 -—aR2 


vee —eé 


where 7° = x?+ y? and a >0. Note that v>0 in Ba, v=0 on Xe, and » <0 outside By. A calculation 
shows that 
Lv] = {4a?(x?+ y?)—2a(2+ bixt boy)} ene” 


Hence, for sufficiently large a, L[v]>0 throughout B3. From (1) it follows that there exists a constant 
68> 0 such that 


ut+ Bo<M on &3 (2) 
Also, 8 > 0, L[u] =0, and L[v] >0 in Bs imply 
Llu+ Bv]|>0 in Bs (3) 


Since u = M and v = 0 at (&, 7), (2) shows that u+ Bv must assume a maximum greater than or equal to 
M at some point (& 7) inside Bs. The necessary conditions for this maximum are 


u, + Bo, = 0= uw, + Boy (4) 
Ux + Bx». =0 yy + Bry 0 (5) 
However, from (3) and (4) and the boundedness of the coefficients 6; and b2, we conclude that 
(Uxx + Bos) + (Uy + Boy) > 0 


which contradicts (5). Thus, the original assumptions of an interior maximum and a nonconstant function 
are incompatible. 

Problems 3.9 and 3.10 provide a proof of Theorem 3.8(i) for R? in the case that the principal part of 
L[ ]is the Laplacian. The arguments employed contain the essential ingredients of the general proof of 
Theorem 3.8. 


For a bounded region Q, show that if uw is a nonconstant solution of 
u,, + U,, + bu, + bu, + cu= f (1) 


with b,, b,,c =0, and f = 0 all continuous on Q, then u can assume a positive maximum only 
on S, the boundary of Q, and not in ©. 


Suppose that M is a positive maximum of u and let Q be the set of points in 1 where uw = M. Since 
a solution of (2) is continuous in 9, we know from calculus that Q is closed (its complement is open) 
relative to N. 

To complete the argument, we show that if Q is nonempty, then Q is also open relative to Q, 
implying that Q = Q and contradicting the hypothesis that uw is nonconstant. Let (, y) be a point in Q, so 
that u(%, 9)= M'>0. Then, by continuity of u, there is a ball, B, in M, centered at (x, y), in which 
u(x, y)>0. Thus, 


Ux, + Uy + bu, + bou, = —cut+ f=0 in B 


Now, from Problem 3.10, we conclude that u must be identically equal to M in 3B. This shows that any 
point in Q has a ball about it that is entirely in Q; i.e., Q is open relative to . 

The above provides a proof of Theorem 3.9(ii) for R? when the principal part of the elliptic operator 
is the Laplacian. A general proof of Theorem 3.9 follows the same lines. 


Let © be a bounded region and Jet L[ ] be as in Theorem 3.9. If u satisfies L[u] =f in Q, 
u= gon S, and if uv satisfies L[v] Sf in O, v= gon S, prove that u<v in]. 
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Since L[u— v] = f- L[v] 20 in D and u~v =0 on S, it follows from Theorem 3.9 that uw — v cannot 
have a positive maximum in Q, which means that u~ v cannot assume a positive value in Q. 
Similarly, we can show that if L[w]=f in O and w<g on S, then u=w in. 


In a bounded region &, if u satisfies 


u,tuy=f ind (1) 
“= g on S (2) 
show that, in 9, 
|u| = max |g(x, y)|+M max | f(x, y)| (3) 
(4 WES (4 yEQ 


where M is a constant which depends on the size of 1. 


If © is not contained in the region x = 0, a translation of coordinates will leave the forms of (7) and 
(2) invariant and will result in x =O throughout 2. Thus, with no loss of generality, we can assume that 
there exists a positive number @ such that 0= x =a for all (x, y) in 11, Define the comparison function 


v = max |g|+ (e* — e*) max |f| 
s G 


Because e* — e* =0 in Q, v = max |g| and 
s 
veg on S (4) 


Calculating L[v] = vx. + vyy, we find, since e* = e° = 1 and f =—max|f\, 
a 


L{v] = —e* max |f|=f inQ (5) 


Inequalities (4) and (5) and Problem 3.12 imply wu = v in 2. Similarly, with w = —v, we have w= g on S 
and L[w]=f in O, so that wu =—v in (. Consequently, in ©, 


|u| <= v = max |g|+ (e* — 1) max | f} 
s 6 


since e* = 1 in ©. This establishes (3), with M = e4—1. 
We term (3) an a priori estimate of u. When some knowledge of the solution is incorporated, much 
sharper estimates are possible. 


Let 2 be a bounded region. Show that the Dirichlet problem 
Vue=f inQ 
u=g on S 
has at most one solution and, if it exists, that the solution depends continuously on the data f 
and g. 
The difference v = u — U2 of two solutions would satisfy the homogeneous problem 
Vv=0 in} 
v=0 onS 


The maximum-minimum principle, Theorem 3.2, implies v =0, or uy = ua, in O. 
To establish the continuous dependence of the solution, let @ satisfy 
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Since L[u— v] = f— L[v] =0in O and u—vsO0onS, it follows from Theorem 3.9 that u— v cannot 
have a positive maximum in 2, which means that uw — v cannot assume a positive value in 0. 
Similarly, we can show that if L[w]=f in 2 and w=g on S, then u=w in Q. 


In a bounded region ©, if u satisfies 


a a a ind (1) 
u=gf on § (2) 
show that, in Q, 
|u| = max |g(x, y)| + M max (f(x, y)| (3) 
(x Es (x ye 


where M is a constant which depends on the size of 0. 


If © is not contained in the region x = 0, a translation of coordinates will leave the forms of (1) and 
(2) invariant and will result in x =O throughout 2. Thus, with no loss of generality, we can assume that 
there exists a positive number a such that 0= x =a for all (x, y) in Q. Define the comparison function 


v = max |g| + (e? — e*) max | f| 
$s Fel 


Because e* — e* =0 in 0, v = max |g| and 
s 
v=¢g on $ (4) 


Calculating L[v] = ve + vy, we find, since e* = e°= 1 and f = —max |f|, 
a 


L[v] = —e* max |f[=f inQ (5) 


Inequalities (4) and (5) and Problem 3.12 imply uv in 9. Similarly, with w = —v, we have w= gon S 
and L{w]=f in Q, so that u =—v in Q. Consequently, in Q, 


|u| = v = max |g|+ (e° — 1) max | f| 
s 3 


since e* 21 in Q. This establishes (3), with M = e“ — 1, 
We term (3) an a priori estimate of u. When some knowledge of the solution is incorporated, much 
sharper estimates are possible. : 


Let 2 be a bounded region. Show that the Dirichlet problem 
Vass ing 
u=f on §$ 


has at most one solution and, if ft exists, that the solution depends continuously on the data f 
and g. 


The difference v = u, — u2 of two solutions would satisfy the homogeneous problem 
V?v =0 in} 
v=0 on S 


The maximum-minimum principle, Theorem 3.2, implies v =0, or uy = ua, in G. 
To establish the continuous dependence of the solution, let &@ satisfy 
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Vi=f in 
a= % onS 
Theorem 3.10 implies 
max |u — al <max |g — g| + M max |f - | (M = const.) 
re) s fh 


which shows that small changes in the functions f and g produce small changes in the solution u. 


Let 0 be a bounded region. Show that the Neumann problem 


Vutcu=f ind (1) 
ou 
—=g on § (2) 
on 


has at most one solution if c<0 in 0. If ¢ =0 in Q, show that any two solutions differ by a 
constant. 


If u,; and uw are both solutions of (1)-(2), v = ur — uz satisfies the homogeneous problem 


Vut+cv=0 ind (3) 
dv 
ae on $ (4) 


Multiply (3) by v and integrate over 2M, using (1.7) and (4): 
-| wor ant | co2an=o (5) 
a 2 


If ¢c <0 in Q, the only way (5) can hold is for v to be identically zero in 0, which implies that (1)-(2) 
has at most one solution. If c =0 in ©, (5) shows that v is constant in 0; Le., the difference of two 
solutions of (1)—(2) is a constant. 


Show that if aB > 0, the mixed problem 


ou 
au+B—=g8 on $ 
on 


has at most one solution in a bounded region Q., 


Again consider the associated homogeneous problem for the difference of (wo solutions: 


Vv =0 inQ (1) 
é 

Bret, piieon on $ (2) 
on 


Multiplying (7) by v, integrating over 0, and using (1.7), we obtain 
5 dv 
o= | vVoda=~ | [Vo| ao+ | v—ds 
a a Ss on 
or, by (2), 
a 
i Iwo? a+ | dS 0 
a sB 


which is impossible unless v =0 in N. 
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3.17 


3.18 


3.19 


Let Q denote the region in R" exterior to the unit sphere: 
Q= {(Xqs Xap HIP SX t apt ctx >y 
Then S, the boundary of , is the surface of the ball of radius 1 centered at the origin. Show 
that the exterior Dirichlet problem 
Vu=0 in (1) 
u=1 on § (2) 
has infinitely many solutions unless some ‘‘behavior at infinity” conditions are imposed. 
By use of the chain rule, one easily shows that the one-parameter family of functions 
peas 
vay(r) = rn? 
1+(-A)logr n=2 


n#2 


—%2 <A <0, all satisfy (7)-(2). (Note that only one member of this family, vga(r), is harmonic at the 
origin; it represents the unique solution of the interior Dirichlet problem.) 
For n = 2, only vq) satisfies the boundedness condition 


lul<A in 2 (3) 


and in Problem 3.19 it is shown that vq) is the unique solution to (1)-(2)-(3) when n = 2. 
For n= 3, every va) is bounded, but only vp) satisfies the condition 


u- 0, uniformly, as r> (4) 


In Problem 3.18 it is shown that, for n = 3, vg) is the unique solution to (1)-(2)-(4). 


Show that the exterior boundary value problem in R” (n = 3) 


Vusf in Q (QO unbounded) 
u=e on S$ 
u(x) > 0 uniformly, as |x| > 


has at most one solution. 


The difference, v = u,— uz, of two solutions satisfies 


V7n=0 inQ (1) 
v=0 on $ . (2) 
v(x) >0 uniformly, as |x|-> 0 (3) 


Let xo be an arbitrary point in 0. From (3) it follows that, given « >0, R can be chosen so that |x| < R, 
and |v(x)| << for |x|= R. In the bounded region © defined by the intersection of Q and the ball |x| < R, 
Theorem 3.2 applies. Since the boundary of © consists partly of S and partly of the sphere Ix| = R, and 
since v = 0 on S$ while |v| < € on |x| = R, it follows that |v(x)| << throughout ©. In particular, |v(xo)| <. 
Since both e€ and xo are arbitrary, v =0, or uw = u2, in QD. 


Show that the exterior boundary value problem 


eid aad in Q (QO unbounded) 
u=g on S 
ju(x,y)|SA in Q (A constant) 


has at most one solution. 
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The difference, v = u,;— uo, of two solutions satisfies 


datdy=0 inQ (1) 
v=0 ons (2) 
ljo(xy, yJ=SC in 2: (C constant) (3) 


Let 0’ denote the complement of ©, so that the union of Q and (1 is the entire xy-plane. Let xo = (Xo, yo) 
be a point in the interior of (’, let 


r= [(x~ x0)? + (9 — yo 


and choose A, sufficiently small so that the ball Br,(xo) is in the interior of O’. Choose R2 sufficiently 
large so that the ball Be,(xo) intersects the region © in a nonempty, bounded region ©. If w is defined by 


log (7/R1) 
log (R2/R1) 


then w is harmonic in Q (by Problem 3.17), w is positive on S, and w= C on the sphere r = R2; hence, 
—w(x, y)S v(x, y) = w(x, y) on the boundary of 0 (4) 


Since v and w are both harmonic in the bounded region Q, Theorem 3.2, applied together with (4) to 
the harmonic functions w+ v, shows that 


lv(x ylsw(xyy) ind (5) 


To complete the argument, let (%, ¥) be an arbitrary point in ©. By substituting (<, y) into (5) and 
allowing R2>© with R, held fixed, we show that v(x, y)=0. Thus, v =0 in Q, which implies, by the 
arbitrariness of the initial Ro, v>=O0inQ. 


3.20 Let 2 be a bounded region and consider the mixed problem 


Vutcu=f inQd (Z) 
fe) 

iiHp-=0. ~ ons (2) 
on 


Show that for (7 )-(2) to have a solution it is necessary that the consistency condition 


i fas (3) 
Qa 
be satisfied by every solution v to the associated homogeneous problem 
Votcv=0 inQ (4) 
ov 
avt+ B—=0 on S$ (5) 
on 


Multiply (2) by v and (4) by u, subtract, and integrate over Q: 


| (vo Vu-uV’v) do=| fudQ (6) 
n a 
But, by (1.8) and the boundary conditions, the left side of (6) vanishes, yielding the consistency 


condition (3). The proof includes the special cases B=0, a #0 (Dirichlet problem) and a =0, 
B #0 (Neumann problem). 


3.21 Show by example that the initial value problem for Laplace’s equation 
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vd 
iS) 
N 


3.23 


3.24 


3.25 


yt B= 0 -O< x Ko, y>d 
u(x, 0)= F(x) —O<¥ <e 
u, (x, 0) = G(x) wc xX <% 


is ill-posed in that the solution does not depend continuously on the data functions F and G. 
The following example is due to Hadamard. For F = F;=0 and G = G, =O, it is clear that u; =0 is 
a solution. For F = Fp =0 and G= G2=n''sin nx, it is easy to verify that 
U2 = —> sinh ny sin nx 
n 


is a solution. The data functions F, and F are identical, and 


lim IG; = G2 = 0 
uniformly in x. Therefore, the data pairs F,, G, and F2, Gz can be made arbitrarily close by choosing n 
sufficiently large. Let us compare the solutions u, and u2 at x = w/2 for an arbitrarily small, fixed, 
positive y and for n restricted to odd positive integral values: 


(Z ) (Z ) 1. ; e”-—e”™ 
u{—, u : sin = 
SOTA OOo oe ees Ne, ge 


Because e” increases faster than n?, 


a€.x)-u(Za)[-> 920 


lim 
nao 


nodd 


The conclusion is that, by choosing n sufficiently large, the maximum difference between the data 
functions can be made arbitrarily small, but the maximum difference between the corresponding 
solutions is then made arbitrarily large. In general, initial value problems for elliptic PDEs are ill-posed 
in this fashion. 


Supplementary Problems 


Verify that each of the following functions is everywhere harmonic: 
(a) x°-3xy? (b) 3x?y- y? (c) e* cosy (d) e*siny (e) 6x+y 
If u and v are solutions of Laplace’s equation, show that uv satisfies Laplace’s equation if and only if Vu 


and Vo are orthogonal. 


If u(x, y) and v(x, y) are the real and imaginary parts of an analytic function f(z), show that uv satisfies 
Laplace’s equation. [Hint: f? is analytic.] 
Let the xy- and &)-coordinates be related by a rotation: 

€=xcosé+ysin@ n=-xsin@+ ycos@ 


where @= const. Show that if uw is harmonic in x and y, then uw is harmonic in € and ». [Hini: Don’t 
differentiate; appeal to the mean-value property. | 
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3.28 


3.29 


3.30 


3.32 


3.33 


3.34 


3.35 


3.36 
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Show that the surface mean-value property, (3.7), is equivalent to the volume mean-value property, 


1 
HS Vac oe 


(see Example 3.2). 
(a) Show that if f(z) = f(x + iy) = u(x, y)+ iv(x, y) has a continuous derivative inQ, then w and v satisfy the 
Cauchy-Riemann equstions, u, = vy, uy = —v,, in Q. (b) Show that if u and v are C? and satisfy the 


Cauchy-Riemann equations, then u and v are harmonic. 


(a) In terms of the cylindrical coordinates defined by x = rcos 6, y = rsin 6, z = z, show that 


Ou du au lady duy 18u du 
+ + = (: )+ + 
ax? ay? az*_—orér\ ar/ £80? az? 
(5) In terms of the spherical coordinates defined by x = rsin @cos ¢, y=rsin @sin g, z = rcos 6, show 
that 


au au a?u 1 a _ ou a/. du a 1 du 
at) SSS (sin 6 )+ (sin 6 )+ (- )I 
ax? dy* az? sin @ Lar or 00 00 dg \sin 0 db 


(a) Show that if u = u(r, 6) is a harmonic function expressed in polar coordinates and wv is defined 
by v(p, 0) = u(y, 6), pr=a’, then v is a harmonic function of (p, 6). (b) Let u(r, 6, @) be a harmonic 
function expressed in the spherical coordinates of Problem 3.28(b). Show that if wv is defined by the 
Kelvin transformation, v(p, 0,6)= a ‘ru(r,0,¢), pr= a’, then v is a harmonic function of 
(p, 8, &). (c) The transformation pr = a? is, in geometrical terms, an inversion in a circle (sphere) of 
radius a. Show that if the circle (sphere) of inversion remains tangent to a fixed line (plane) as the radius 
a approaches ~, the transformation becomes a reflection in the fixed line (plane). Thus, harmonic 
functions in R* and R® can be continued by inversion/reflection. 


(a) If a harmonic function is positive on the boundary of a bounded region Q, prove that it is positive 
throughout £2. (6) Show by example that if 0 is unbounded, the result of (a) may not be valid. (c) Let u, v, and 
w be harmonic in a bounded region © and let u=v=w on the boundary of 2. Show that u=v=sw 
throughout 2. 


Prove Hamack’s theorem: A uniformly convergent sequence of harmonic functions converges to 
a harmonic function. [Hint: For “harmonic function” read “function with the mean-value 


property.’ | 


Show that a C? function uw is subharmonic if and only if V*u=0, and superharmonic if and only if 
Wu =0. 


(a) If & is subharmonic in the ball Br (xo), u= M in Br (xo), and u(x) = M, show that u = M everywhere 
in Br(xo). (6) If u is subharmonic in a bounded region Q and uw attains its maximum value at an 
interior point of Q, show that u is constant in 2. 


Suppose that u is harmonic in a bounded region and v is subharmonic in Q. Show that if uw = v on the 
boundary of , then u>v throughout 2. 
If 0 is the region 0<x<1,0<y<1, use Theorem 3.8 to show that the solution of 


Ux, + Uyy — Bux = 5 in 


u=0 on S$ 


satisfies -5/3<u<0Oin Q. [Hint: Consider also the Dirichlet problem for v = u + (5/3)x.] 


Show that if u satisfies u.. + e*uy — e?u = 0 in a bounded region O and if wu =0 on the boundary of Q, then 
u=0 throughout Q. 
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3.41 


3.42 


3.43 


3.44 


3.45 


3.46 


=~ 


If u(r, @) satisfies V7u =0 in r<1, u(1, 6) = f(@), show that Poisson’s integral formula in R? takes the 
form 


u(r, A= 


ie a0 (9) dé 


2mr J_,1-2rcos(@-@)+r 


(See Problem 7.13 for a derivation of this version of Poisson’s formula.) 


If tye + Wy = 0 in x? + y?<1, and u= y?x on x*+ y?=1, find u(0, 0). [Hint: The boundary values are 
antisymmetric about the y-axis. ] 


Tf ua t dy =O in x? + y?<1, andu=3+x+y on x?+ y?=1, find u(3, 3). 
In the Dirichlet problem V7u(r, 6€)=0 in r<1, u(1, 0)=f(0) (-2 <6 77), show that a change in the 
data function f(@) over an arbitrarily small interval (6;, 62) affects the solution value u(y, @) for all r<1 


and all 6. 


Show that the Neumann problem 


Vu =1 in x?+ y?<] 
ou 
—=2 onx*t+y?=1 
on 
does not have a solution. 
Show that 
Uy, + Uy + 2u = f inQ: O<x<n,0<y<a7 
u=0 ons 


(a) has no solution if f = 1, (b) has solutions of the form 


u= > ann Sin mx sin ny 


mon=l 


for certain constants Gmn, if f = cos x cos y. Determine these constants. 


Show by example that if (i) c=0 or (fi) ¢ >0, the boundary value problem of Problem 3.15, with 
f= g=0, has a nontrivial solution. 


Let 2 be a bounded region whose boundary S$ consists of nonempty, complementary components S; and 
S). Show that the boundary value problem 


Vu=f in 
u= 81 on S, 
Ou : 
on on S2 


has at most one solution. 


Suppose L[ ] and Q satisfy the hypotheses of Theorem 3.9 and consider the boundary value’ problem 
L[u] =f in Q, u=g on S. Let u, and u2 denote, respectively, solutions corresponding to the data (fi, 81) 
and (fz, g2). Show that fifo in QO and g, = g2 on S implies uw, u2 in |. 
If u(x, y) satisfies 
Ur, + Uyy = 0 in x?+ y?<] 
(uz+u2)u=0 onx?t+y?=1 


show that u is a constant. 


Chapter 4 


Qualitative Behavior of 
Solutions to Evolution Equations 


4.1. INITIAL VALUE AND INITIAL-BOUNDARY VALUE PROBLEMS 


Unlike elliptic PDEs, which describe a steady state, parabolic or hyperbolic evolution equations 
describe processes that are developing in time. For such an equation, the initial state of the system is part 
of the auxiliary data for a well-posed problem. If the equation contains time derivatives up to order k, the 
initial state can be characterized by specifying the initial values of the unknown function and its time 
derivatives through order k — 1. 


EXAMPLE 4.1 The heat equation serves as the canonical example of a parabolic evolution equation. Problems 
which are well-posed for the heat equation will be well-posed for more genera] parabolic equations. 


(a) Well-Posed Initial Value Problem (Cauchy Problem) 


u=K Wu(x,t) in R’, 1>0 
u(x, 0) = f(x) in R" 
ju(x, | <M in R", t>0 


The boundedness condition at infinity (which is not the most general condition possible) is independent of 
the spatial dimension n. 


(b) Well-Posed Initial-Boundarry Value Problem 
u= «x Vu(x, t) inQ, t>0 
u(x, 0) = f(x) inQd 
é 
I a(x)ux, 1)+ BR) (= 8%) on S, 1>0; a8 =0 
n 


Special values of a and £ lead to boundary conditions of Dirichlet or Neumann type (Section 1.3). If Q is 
not bounded (e.g., a half-space), then g(x, f) must be specified over the accessible portion of S and 
additional behavior-at-infinity conditions may be needed. 


EXAMPLE 4.2 The wave equation serves as the prototype for hyperbolic evolution equations. 
(a) Well-Posed Initial Value Problem (Cauchy Problem) 


Un = a? Vru(x, t) in R", t>0 
u(x, 0) = f(x) in R" 
u,(x, 0)= g(x) in R" 


No behavior-at-infinity conditions are necessary in order to obtain a unique solution to the Cauchy problem 
for the wave equation. 


(5) Well-Posed Initial-Boundary Value Problem 


Un = a? V?u(x, t) inQ, 1>0 
u(x, 0) = f(x) and u(x, 0) = g(x) inQ 


ou 
a(x)u(x, t)+ BO) HN=h(x) on S, 1>0; a8 =0 
in 
2 may be unbounded, with no condition at infinity required. 
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If the initial conditions in a well-posed initial value or initial-boundary value problem for an 
evolution equation are replaced by conditions on the solution at other than the initial time, the 
resulting problem may not be well-posed, even when the total number of auxiliary conditions is 
unchanged. 


EXAMPLE 4.3 
(2) Backward Heat Equation 


Uy = KUxx(X, t) O<x<1,0<t<T 
u(x, T) = f(x) O0<x<1 
u(0, b= ul, )=0 O<'t<T 
Here the initial condition of the forward problem has been replaced by a terminal condition specifying the 
state at a final time t= T. The problem is to find previous states u(x,t) (tf < T) which will have evolved at 


time T into the state f(x). For arbitrary f(x), this problem has no solution. Even when the solution exists, it 
does not depend continuously on the data (see Problem 4.9). 


(b) Dirichlet Problem for the Wave Equation 


Un = u(x,t) O<x<1,0<t<T 
1 u(x, 0)=flx) O<x<] 
u(x, T)= g(x) 0<x<] 
u(0, = ul, )=0 O<'t<T 
Here the initial condition on u, has been replaced by a terminal condition on u. The solution to this 
problem does not depend continuously on the data (see Problem 4.20). 


4.2) MAXIMUM-MINIMUM PRINCIPLES (PARABOLIC PDEs) 


Neither the wave equation nor hyperbolic equations in general satisfy a maximum-minimum 
principle, but the heat equation and parabolic equations of more general form do so. 

Let Q denote a bounded region in R® whose boundary is a smooth closed surface S. Suppose 
u(x, y, z, t) to be continuous for (x, y, z) in @ and 0<¢tT;, for short, in Ox [0, T]. Let 


M, =max (u(x, y, Zz, 0): (% y,z)on S and0=t=T} 
M, = max {u(x, y, 2, 0): (x, y, Z) in © and t= 0} 
M = max {M,, M,} 


and let m,, m,, and m denote the corresponding minimum values for u. 


Theorem 4.1 (Maximum-Minimum Principle for the Heat Equation): Given that u(x, y, z, t) is 
continuous in 0 x [0, T]: 
(i) If u,—Vu=0 in Ox (0, T), then u=M in Ox (0, T]. 
(ii) If u.-Wu=0in Ox (0, T), then u=m in Ox (0, T]. 
(ii) If u,—Vu=0 in Ox (0, T), then msu<M in Qx (0, T]. 


According to Theorem 4.1(iii), the temperatures inside a heat conductor are bounded by the extreme 
temperatures attained either inside initially or on the boundary subsequently. Theorem 4.1 is useful 
in establishing uniqueness and continuous dependence on the data and to obtain various comparison 
results for the solutions to initial-boundary value problems for the heat equation. 

The maximum-minimum principle may be extended in various ways; the next theorem states that 
if an extreme value of a nonconstant solution of the heat equation occurs on the boundary S, then the 
normal derivative of the solution (the heat flux) cannot vanish at that point. 
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Theorem 4.2: Let u be C' in 1x [0, T] and satisfy 
u,-Wu=0 in x (0, T) 


Then, either u is constant in © x [0, T] or else 


(i) at any point &€ on S such that u(é, r) = mM, = ae r)>0; 


(ii) at any point é on S such that u(é, r) = m, — « rT) <0. 


f 
i 


” Results analogous to Theorems 4.1 and 4.2 hold for parabolic equations more general than the heat 
equation. 


Definition: If the linear differential a 


LI I= 5 a, om, Ate i li 


Eyal x; 


is uniformly elliptic (Section aD in a for each ¢ in (0, T], then the operator 


+c(x,t)[ ] (4.1) 


is said to be uniformly parabolic in Ox [0, T]. 


Theorem 4.3: Let © be a bounded region in R” with smooth boundary S, and suppose that 0/at— L 
is uniformly parabolic in © [0, T], with coefficients @, and 6, continuous in 
Q.x [0, T] and coefficient c = 0. Suppose also that u(x, f) is continuous in x [0, T]. 
Then the conclusions (i), (ii), (iii) of Theorem 4.1 hold, with V’[ ] replaced by L[_ ]. 


Theorem 4.4: Theorem 4.2 remains valid when the operator 9/dt— V’ is replaced by the uniformly 
parabolic operator 0/dt— L of Theorem 4.3. 


The conclusions of Theorems 4.3 and 4.4 regarding the solution to u,~ L[u] = 0 continue to hold 
if c(x, 1)<0 and M = 0—and even in another case (see Problem 4.21). 
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Two properties characterize the time-behavior of systems modeled by parabolic PDEs. To 
describe the second of these, we introduce the notion of an ‘‘evolution operator” that takes the initial 
state u(x, 0) of the system into the evolved state u(x, £). 


Infinite speed of propagation. At any time t > 0 (no matter how small), the solution to a parabolic 
initial value problem at an arbitrary location x depends on all of the initial data. (See Problem 4.7.) 
As a consequence, the problem is well-posed only if behavior-at-infinity conditions are imposed. 


Smoothing action of the evolution operator. A solution u(x, t) to the Cauchy problem for the heat 
equation is, for each x and all ¢ > 0, infinitely differentiable with respect to both x and #4. (See Problem 
4.8.) 


There is an interesting consequence of the smoothing property of the evolution operator for the 
heat equation, A sectionally continuous initial state u(x, 0) can always evolve forward in time in 
accordance with the heat equation. However, if it is not infinitely differentiable with respect to both x 
and ¢, then it cannot have originated from an earlier state u(x,t), t<0. Thus the heat equation is 
irreversible in the mathematical sense that ‘“‘forward’’ time is distinguishable from “backward” time. 
Correspondingly, any physical process for which the heat equation is a mathematical model is 
irreversible in the sense of the Second Law of Thermodynamics. 
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In an initial-boundary value problem for a parabolic PDE, the solution will be smooth for 
all t>0 and all x inside the domain. In order for the solution to be smooth on the boundary and at 
t = 0, it is necessary to impose smoothness and compatibility conditions on the data. 


EXAMPLE 4.4 The problem 
+ 


u(x, 1) = Usx (x, 1) O<x<ZL, 1>0 
u(x, 0) = f(x) O<x<L 
u(O, t)= g(t) and u(L, t)= h(t) 1>0 


has a solution u(x, t) which is going to be infinitely differentiable with respect to both x and ¢ for0<x<JL and 
t>0. In addition, the solution will be continuous with respect to x and ¢ for O=x=2L and 120, 
provided (i) f(x) is continuous for O=x=L, and g(t) and h(t) are continuous for +=0, (ii) f(0)= g(0) and 
f(L)= #(0) (compatibility of initia! and boundary data). 

Additional conditions on the smoothness and compatibility of f, g, and kh will result in additional 
smoothness of u(x, 4) forO< x= TL, t=0. If such conditions are lacking, the solution may satisfy the initial and 
boundary conditions in a mean-square but not a pointwise sense. 


4.4 WAVELIKE EVOLUTION (HYPERBOLIC PDEs) 
The following two properties contrast with those of diffusionlike evolution. 


Finite speed of propagation. A solution to an initial value problem for the wave equation 
corresponding to initial data that vanish outside some bounded region will itself vanish outside a 
region which is bounded but expands with time. The rate at which this expanding region grows can 
be interpreted as the (finite) speed of propagation of the effect modeled by the wave equation. 


Lack of smoothing action in the evolution operator. The solution of a hyperbolic initial value 
problem cannot be smoother than the initial data; it may in fact be Jess smooth than the data. When 
irregularities in the solution to a hyperbolic equation are present, they persist in time and are 
propagated along characteristics (cf. Problem 2.10). 


Finite propagation speed has various consequences. For instance, at any point in the spatial 
domain at any finite time ¢>0, the solution to a hyperbolic initial value problem depends on only a 
portion of the initial data. The set of locations x such that the solution value assumed at x at time ¢ = 0 
affects the value of the solution at (x, f,) constitutes the domain of dependence for (Xp, t). For each (Xp, to) 
the domain of dependence is of finite extent; consequently, the initial value problem its well-posed 
without the specification of behavior at infinity. 

The lack of smoothing action in wavelike evolution is related to the fact that physical processes 
modeled by the wave equation are thermodynamically reversible. An initial state u(x, 0) that is 
lacking in smoothness can evolve forward in time in accordance with the wave equation and can, as 
well as not, have originated from an earlier state. Thus we can solve forward in time to find 
subsequent states into which u(x, 0) will evolve, or we can solve backward in time to find earlier 
states from which u(x, 0) has evolved. 
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Solved Problems 


Prove theorem 4.1. 
Suppose that u(x, y, z, 0) is continuous in Ox [0, T] and satisfies 
u,— Vu <0 in 2x (0, T) 
For € > 0, let v(x, y, z, 0 = u(x y, z, ft) t+ €(x? + y?+ 27). Then, 
v, — Vv = —6€ <0 in 2x (0, T) (1) 


Suppose now that v assumes its maximum value at (Xo, yo, Zo, fo), where (x0, yo, Zo) is an interior point of 
Q and 0< %#s T. Then, at (xo, yo, Zo, to), 


v, 20 and Vv <0 


which contradicts (1). Hence, v must assume its maximum value for (x, y, z) on S and 0 =tT, or else 
for t= 0 and (x, y, z) in Q. 
The definition of v implies that 


ux<vemaxv=M+eR? — in Ox [0, T] 


where R? = max (x7 + y? + z). Since € > 0 is arbitrary, it follows that u = M in Ox [0, T]. Thus Theorem 
Ss 


4.1(i) is proved. 
Theorem 4.1(ii) is proved by applying Theorem 4.1(i) to the function —u; then Theorems 4.1(i) and 
4.1 (ii) together umply Theorem 4.1(iii). 


Let 0, S, T be as previously described and consider the problem 
u,— Vu = ®(x, y, z, £) in 22x (0, T) 
u(x, y, z,0) = F(x, y, z) in Q 
u(x, y, 2, 0 =flx, y, z, 0) in SX [0, T] 
Show that if this problem has a solution u that is continuous in © x [0, TJ, then this solution is 
unique. 


Method 1 


The difference v(x, y, z, t) = us(x, y, z, 2) — 4u2(x, y, z,£) of two continuous solutions is itself con- 
tinuous and satisfies 


pn — Vv =0 in 2x (0, T) (1) 
v(x, y, 2,0) =0 inQ (2) 
v(x, y, 2, t)= 0 in Sx [0, T] (3) 


For the function v, (2) implies mo = Mo = 0, and (3) implies ms = Ms = 6. Hence, m = M = 0, and, by 
Theorem 4. 1(iii), v =0. 


Method 2 
For 0<t= 7, define the energy integral 


1o= | v* dO (4) 
a 
where v ts the difference function of Method 1. Clearly, J(#)=0 and, by (2), /(0)= 0. In addition, 
r(o= | 2vv, dO = 2 vV?vdQ 
a a 


fo 
=2{ »as-2] vor ao 
s on a 


” 


4 
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where we have used (1) and (1.7). By (3), the boundary integral vanishes, leaving 
J(H= -2{ Vo? da <0 (5) 
Qa 


Thus J(4) is nonincreasing, which fact, along with J(0) = 0 and J(t) = 0, implies that J(‘) = 0. But then, the 
integrand v(x, y, z, in (4) being nonnegative and continuous with respect to all arguments, it follows that v 
1s identically zero in 2) far t=O. 

The energy integral method may be extended to the case of Neumann or mixed boundary conditions, to 
which Theorem 4.1] is not directly applicable. See Problem 4.16. 


For the initial-boundary value problem of Problem 4.2, let u, and u, denote solutions 
corresponding to data {®,,F,,f,} and {®,, F,, f}, respectively. Suppose that p, =, in 
Ox (0, 7), Fi =F, in O, f= f,in Sx [0, T]. Prove that u, = uv, in Ox [0, T]. 


Letting v = uw,— uz, we have 
vy -Vv=0,-8<0 inXx(0,T) 
In addition, for the function v, 
Mo = max {F, — Fo} =0 Ms = max {f:—f2}=0 
a Sx10, T) 


whence M <0. Then Theorem 4.1(i) implies that v <0, or uw; = ua, in 2x [0, T]. 


For «, T positive constants, suppose that v(x, f) satisfies 


U, = KD,, O0<x<1,0<'1<T (1) 

v(x, 0) = 0 O<x<1 (2) 

v, (0, £) = g(t) 0<t1<T (3) 

v, (1, ) = 0 0<1<T (4) 

If g(0)=0 and g’(t)>0 for ¢>0 (whence g(t) >0 for ¢> 0), shew that forOsxs1,0<t=T. 
(a) v(x, t)=0 (b) v,(%, 020 (c) v,,(41) 50 

(a) Apply Theorem 4.3 (or, after changing the time variable, Theorem 4.1) to (1) in order to conclude 


that 


v(x, 1) Ss M Osxs1,085tST 


The outward normal derivative of v at x =0 is ~v,(0, 1) g(t)<0; hence, by Theorem 4.4 (or 
Theorem 4.2), the maximum M cannot occur at x = 0. The outward normal derivative at x = 1 is 
vx (1, 1) = 0; so the maximum cannot occur at x = 1 either. It follows that Mf = My=0, whence 


v(x, 1) =0 Osx<1, 05'(8ST 
(b) Let u(x, 1) = v,(x, 2). Differentiate (7) with respect to x, to find 
Dex = KU xxx O<x<1,0<71<T (5) 
If v is sufficiently smooth, ve = vu = u,, and (5) becomes 
Uy = KUxy O<x<1,0<91<T (6) 
which is the same PDE as is satisfied by v. 


Theorem: If a function satisfies a linear PDE with constant coefficients, its derivatives satisfy that 
same PDE. 


Equations (2), (3), and (4) imply the following auxiliary conditions for (6): 
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u(x, 0)=0 O0<x<1 
u(0, t) = g(t) 0<1<T 
u(1, 1) =0 0<1<T 
For the system (6) through (9), Theorem 4.3 gives 
O=msulx, bh) 0sx51,0s'tsT 
which is what was to be shown. 
Define w(x, t)=v,(x, £). Then, as in (b), 
w, = kwyx O0<x<1,0<'1<T 
w,(0, t) = g’(t) 0<'t<T 
w,(1, 4) =0 0<'t<T 


In addition, from (a), v(x, t)=0= v(x, 0). Hence, 


v(x, 0) = lim 


10t 


v(x, t)~ v(x, De% 
pa 


or w(x, 0) <0 O<x<1 
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(7) 
(8) 
(9) 


(0) 
(11) 
(12) 


(13) 


Applying Theorem 4.3 to system (10) through (13), we see that the maximum of w must occur at 


t=0in0<x <1; that is, 


v(x O= w(x )S=Ms0 OSx51, 051=T 


Then, since « > 0, vx(x, t)= x 'y(x, 50, forOsxsiand0s¢sT. 


Making use of the results of Problem 4.4, plot u(x, 4) versus x for several values of t. 


“Profiles” for three ttme values are plotted in Fig. 4-1. The curves are below the x-axis, in 
accordance with Problem 4.4(a). On x = 0 we have v,(0, f) =0 (Problem 4.4(c)) and v, (0, ¢) = g(t); thus, 
the starting value is a negative, decreasing function of time, while the starting slope is a positive, 
increasing function of time. The curves are concave (Problem 4.4(c)), and have final slope zero 
(vy (1, £) = 0). 


Inspection of Fig. 4-1 suggests that, for each fixed ¢ in (0, T], 


v(0, )= vi, O=v(1, 4 O=xs1 


and, indeed, this follows at once from Problem 4.4(b). 


v(x Oj 


O< 4h gs T | 


Fig. 4-1 
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Let u(x, t) be a solution of the nonlinear problem 


u(x, 1) = a(u)u,,(x, £) O<x<1,0<'t<T (1) 
u(x, 0)=0 0<x<1 (2) 

u.(0, t) = g{t) 0<t<T (3) 

u,(1, #)=0 O0<t<T (4) 


Assume that g(/) is continuously differentiable, with g(0) = 0 and g’(t) > 0 for ¢ >0. In addition, 
assume that a(x) is continuous and satishes 


N<B,Sa(u)=B, for all u (5) 
Let v,(x, 2) (i= 1,2) denote the solutions of the linear problems 
0,05 1) = Bv,..(% 8) O<x<1,0<t<T 
v{x, 0) = 0 O<x<1 
v,,(0, £) = g(t) O0<t1<T 
v,,(1, = 0 O0<¢<T 
Prove that 
v(x, t= u(x, =v, (x, 1) O=x21, 08tsT (6) 
Define h(x, t) = valx, )- u(x,t) O<x <1, 0<1t<T), Then A(x, 4) must satisfy 
h(x t)— a(u(x, D)Itex(x, 2) = [Ba alulx, ))]Paax(x, 1) <0 (7) 
where the inequality follows from (5) and Problem 4.4(c). Further, we have 
h(x, 0)=0 O<x<] (8) 
h,(0,)=h. 1, )=0 O<1<T (9) 


For the problem (7)-(8)-(9), Theorem 4.4 and (9) rule out a boundary maximum for A. Thus, 
M = M = 0, and Theorem 4.3 implies that A(x, f)=0; or 


v2(x, t) S u(x, £) Osxe1, 0O5'tsT 


A similar consideration of the difference k(x, 1) = u(x, £)— v(x, £) yields the other half of (6). 


As is shown in Problem 4.17, the function 


1 f° (x= yy 
u(x, 1) = —— ( F(y) exp| |e (1) 
V4rt?_,, 4t 
solves the initia] value problem 
ix, 1) = uf) —we<cx cow, 1 >0 (2) 
u(x, 0) = F(x) —~ <x <0 (3) 


Verify the infinite speed of propagation asseciated with diffusionlike evolution by showing that 
(a) for each ¢>0 and all x, u(x, t) depends on all the initial data F(x), -© <x <<; (b) for the 
particular data 


() |x| <e€ 


ai me oe 


(4) 


u(x, t)>0 for all x and every positive 4 no matter bow small the positive number e. 


(a) For each t>0, 


x—yy 
exp [-‘ 2) |>0 for all x and y 
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It follows from (1) that for each ¢>0 and all x, the value u(x, 4) incorporates every F(y), 
-a<ay<o, 


The change of variable 


z= (t>0, -e< x, y <0) 
V4t 
transforms (7) into 
1 
u(x, y-—] e7? F(x— 2V41) dz (5) 
Vit? 
But, by (4), 
1 —eVV4t<z<(xt+eVV4e 
F(x- 2V4t) = { (x-€)/ z<(xt+e)/ 
0 ail other z 
so that (5) becomes 
(exter , 
u(x, t)=—= e* dz -a<cxy<aw, 1>0 (6) 
TT (x-ay Vai 


Since e7??> 0 for all real z, it follows that u(x, t)>0 for all x and 4 That is, the solution u(x, #) is 
immediately positive everywhere, even though F is zero everywhere except in the arbitrarily small 
interval (—e, e€). 

Note, however, that because e~ 


CO a ee 


Thus, even though the influence of the initial state propagates with infinite speed, the strength of 
this influence dies out very rapidly (as e~”) as the distance (r = |x — e|) from the set where F #0 
increases. We are therefore able to claim that although solutions to the heat equation exhibit a 
honphysical property (infinite speed of propagation), they do behave in a manner that is an 
acceptable approximation of reality. Practically speaking, effects governed by the heat equation 
propagate with finite speed. For more on this matter, see Problem 7.8. 


z 


* is monotone decreasing, (6) implies that 


Let f(x) denote a sectionally continuous function in (0, 7). Then, using separation of variables 
(Chapter 8; see also Problem 4.18), one shows that 


u(x, = DS f,e sin nx O<x<a, t>0 (1) 
n=t 
is the solution to 
u,(x, t) = u(x, 2) O0<x<7, t>0 (2) 
u(x,0)= f(x)  O<x<7 (3) 
u(0, t)= u(a, t)= 0 t>0 (4) 
provided 
2 wT 
| f(x) sin nx dx (n=1,2,...) (5) 
79 


Demonstrate the smoothing action of the evolution operator in this case. 


At +=0, (1) reduces to 


u(x, 0) = > f, sin nx 
na=l 
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and this series converges pointwise to F(x), the odd 27-periodic extension of f(x), provided F, and F 
are sectionally continuous (see Problem 6.1(d)). 
For each n= 1,2,... and for each positive 4 


lf. e~"”' sin nx| = (constant) e~"” = (constant) (e7')” 


and the geometric series is convergent. It follows from the Weierstrass M-test that, for each fixed t>0, 
the series in (J) converges absolutely and uniformly to a continuous function of x. The same can be said 
of the series obtained from (1) by term-by-term differentiation any number of times with respect to x 
and/or 4 We conclude that the series in (/) represents a function which is not just continuous but is 
infinitely differentiable with respect to both x and ¢ for t>0O andO<x< 7. 

The evolution operator &,, 


@,[u(x, 0)] = u(x, 4) t>0 (6) 
can be characterized in terms of the Founer sine-series coefficients of the states, as follows: 
tlal=ke > -150 (7) 


We have seen that whereas the f, represent a function of x that is not necessarily even C°, their images under 
&, represent a function that is C™. It is characteristic of solutions to the heat equation (and parabolic 
equations in general) that u(x, t) isan extremely smooth function for t > 0, even if u(x, 0) is not particularly 
smooth. 

For parabolic equations having variable coefficients, the smoothing action of the evolution operator 
may be limited by a lack of smoothness in the coefficients. 


Show that the backward heat problem is ill-posed, as asserted in Example 4.3(a). For 
simplicity, choose « = 1. 


Write u(x) = u(x, 0), the initial state (temperature). Then (cf. Problem 4.8), the function 


u(x, t)= >, uM eo? sin nx O<x<1,0<r1<T (1) 


n=l 


where 
1 
uy? = 2{ u(x) sin narx dx (n= 1,2,...) 2) 
0 


will solve the problem, provided the wu” are such that 


oy 


fixy= SuPer’? sinnax = 0<x <1 (3) 
mal 
But the series in (3) converges uniformly to an infinitely differentiable function of x, whatever the uf”. It 
follows that no solution exists when f(x) is not infinitely differentiable. 
In the case where f(x) is infinitely differentiable, the solution does not depend continuously on the 
data. If, for instance, 


sin Narx ; 
f(x~= o (N = integer) 


the unique solution to the problem is 
1 N2n7(T—1) os + 
ule sin Narx O0<x<1,0<1<T 


For large N, on the one hand, | f(x){ becomes uniformly small; that is, the data function differs by as little 
as we wish from the data function f =0, to which corresponds the solution uw =0. On the other hand, 
|u(x, £)| grows with N; i.e., the solution does not remain close to u =0. Thus, there is no continuity of 
dependence on the data. 
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4.10 Show that the solution to 


4.11 


u, (x, t) = a°u,, (x, t) -w<xy<w, ¢>0 (J) 
u(x, 0) = F(x) —o< _y <0 (2) 
u,(x, 0) = G(x) —wo< ¥ <0 (3) 


may be given in the D’ Alembert form 


1 1 Xtal 
u(x, )==[F(x+ at)+ F(x - at)|+ --| G(s) ds (4) 
2 20) a 
We shall obviously want to apply the theory of Chapter 2. In terms of the characteristic coordinates 
€=xtat n=x-—at 
the problem takes the form 
Yen (Sn)=0 ~-o<n <E<o (5) 
u(gg)=F(E) —-w<f<o (6) 
1 
ue(& €)— uy (8, g)=7 GE) 0 < E <oo (7) 
Integrating (5) in two steps: ug = @(£) and 
ulén)= | b@) dé +¥(n) = ©) + ¥(n) (8) 
Applying conditions (6) and (7) to (8): 
P(e) WE)= FE) (9) 
1 
P(g) — ¥'(é) = - G(é) (10) 
Solving (9) and the integral! of (70) for the unknown functions: 
1 1 /f 
o@-5[F@+—] G1s)4s| (11) 
1 1/” 
vin)=5[Fn)-— | G(s) as | (12) 


Substitution of (21) and (12) in (8), and transformation back to the variables x and 4 gives (4). Note 
that whereas the integral in (4) effects one order of smoothing of G (the initial data for u,), there is ne 
smoothing of the initial state F; contrast this with the heat equation. 


For the hyperbolic problem (1/)-(2)-(3) of Problem 4.10, (@) describe the domain of 
dependence of a point (Xp, f), where t,>0; (b) if F and G both vanish for |x| > 1, show that 


u(1t+a,t)=0 forOst=<1 
and interpret this result. 


(a) By (4) of Problem 4.10, u(xo, t) depends on the values of F for the two arguments xo + af and 
Xo~ Qty, and on the values of G over the interval (xo - @fo, Xo + @t). Thus, the domain of 
dependence of (xo, f) is the closed interval [xo — aa, Xo + ato], which is precisely the portion of the 
x-axis cut off by the two characteristics 


x+at= 5 x-at= 


that pass through (Xo, fo). See Fig. 42. 
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4.12 


Domain of dependence 


Fig. 4-2 


(6) Because F and G each vanish outside |x| <1, u(1+ a, t) must remain zero so long as the domain of 
dependence of the point (1+ a, ¢), [1+ a — at, 1+ a+ at], remains disjoint from (—1, 1); that is, so long 
as 


1l+a-at=1 or Osts1 


Now, the distance from the point (1 + a, 0) to the interval (—1, 1) is just a units. Consequently, 
our result may be interpreted to mean that the influence of the initial data requires just 1 unit of 
time to traverse this distance; i.e., the propagation speed is a units of distance per unit of time. 


Consider the following modification of the n-dimensional wave equation: 


n 


+ 2 =. 
Hg Bp Cj 4, = 0 (1) 
jel 
where c,,...,¢, denote real constants. Show that for an arbitrary function F in C and an 
aroitrary unit vector a = (a,,...,4a,), 
u(x, 1) = Fla+x— pt) (2) 
satisfies (1), provided yp. satisfies 
2 Me .2.. 2 
B= DCF a; (3) 


j=1 


Substitute (2) in (7), to find 


(u2~ Di c?a?) P(a-x~ pt)=0 
jel 
Evidently, if 4 satisfies (3), then u(x, f) as given by (2) is a solution of (7), with no further restrictions on 
F orone. 

For each fixed 4 o:x = wt+ const. is the equation of a plane in R” having normal vector @. For this 
reason, (2) is called a plane wave solution to (1). The function F is called the waveform and « represents 
the direction in which the wave progresses. While both F and @ are arbitrary, the wave velocity pw 
depends on @ via (3). Evidently, (7) models wave propagation in a nonisotropic medium. 
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Consider the initial-boundary value problem 
u(xd=a@u(x) O<x<L, t>0 
u(x, 0) = F(x) O<x<L 
u(x,0)= G(x) O<x<L 
u,(0, t) = u,(L, t)=0 t>0 
Show by the energy integral method (cf. Problem 4.2) that if this problem has a solution, then 
the solution is unique. 
Let u,(x, ¢) and uo(x, 1) denote two C' solutions and let v(x, t) = ui(x, t)— ue(x, t) forcO< x <L,1>0. 


Then v(x, £) satisfies the initial-boundary value problem with F(x) = G(x)=0 for 0<x <L. Defining 
the energy integral tn thts case as 


E(t) | [or (x, t)? + a7v,(x, 0)?] dx 


we have 
“£ 
E()= i [a (x, Don(x, t+ a? ox(x, va (x, t)) dx 
0] 
But 
2 2 2 2 a 
VOVa + A°VeVxr = (Vg — A°Vxx) + A? (Vex + VxVe1) = a =f (vxv,) 
x 
Therefore, 


if x=b 
SEW = vo, (x, t)u.(x, t) 
a x=0 
and the boundary conditions imply that E’(t)=0. The initial conditions imply that E(0)=0; con- 
sequently, E(t) = 0 for f= 0. But then the C° functions v, and v, must be identically zero, so that v(x, 1) 
is a constant. Because v(x, 0) = 0, this constant must be zero. 

If the original boundary conditions are replaced by the conditions u(0, 4) = u(L, f) = 0, then 


v(0, t) = v(L, 1) = 0 


and the uniqueness proof goes through as before. 


Let f(x) and g(x) be defined on [6, az], where they are sectionally continuous with sectionally 
continuous derivatives. Let FE and G, denote the odd 27-periodic extensions of f and g ta the 
entire real axis (Problem 6.1(b)). (a) Show that the solution of the initial—-boundary value 
problem 


u(x )=au(%40 O<x<7, t>0 (1) 
u(x, O)= f(x) O<x<a7 (2) 
u,(x, 0) = g(x) O<x<7 (3) 
u(0, t) = u¢a, th=0 t>0 (4) 
is given by 
me ; (Riz + at) + FE (x— ad) + = ie G.(s) ds (5) 


(b) Relate the smoothness of the solution u(x, 2) to the smoothness of the data f, g and to the 
compatibility between the initial data and the boundary conditions (4). 
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(a) According to Problem 4.10, (5) is the solution of the following initial value problem: 


n(x, t) = a7. (x, 2) -w<xy<cow, ¢>0 
u(x, 0) = F(x) -w<i x <0 
u(x, 0)= G(x) -eo<x <0 


Since F,(x)= f(x) and G,(x)= g(x), for 0<x <2, the expression (5) satisfies the PDE (1), 
together with the initial conditions (2) and (3). Moreover, for t > 0, 


u(0, t)= slFlat)+ F,(—at)] + = i G,(s) ds =0 


since F, and G, are odd functions. Similarly, using the 27-periodicity, u(z, t)=0 for £>0. Thus 
u(x, f) as given by (5) satisfies (4) as well. In Problem 4.13 we proved that the problem (/) through 
(4) has at most one solution; therefore, (5) is the solution. 


(b) Differentiation of (5) gives 


any a” (m+n) (mtn) i 
Samy FPS Get at) + FEM x ~ at\(-1)"] 
xX 
ao = 
4 a [Gort D(x ae aty— (“IP PGS P(x ee at)| 


(m,n =0,1,2,...). Evidently, the continuity of u(x, ¢) and its derivatives is determined by the 
smoothness of & and G,, which, in turn, is dependent on the smoothness of f and g in [0, a], and 
the compatibility of f and g with the boundary conditions (4). 

In Problem 6.4 it will be shown that F,(x) and all its derivatives through order M are 
continuous for all x if and only if: 

(i) f(x) and all its derivatives through order M are continuous on [0, 7]; 

(ii) for all nonnegative integers n such that 2n = M, f2(0) = f(a) = 0. 
Now (ii) is just the condition that f and g and their even-order derivatives satisfy the boundary 
conditions, this is what is meant by compatibility between the initial data and the boundary 
conditions. If, for some M > 0, (i) or (it) is not satisfied by both f and g, the solution u(x, ¢) will 
experience some sort of discontinuity along a characteristic. For example, if g(0)# 0, then G,(x) is 
discontinuous at every integer multiple of a, which means, by (6), that u(x, 4) and u(x, ) 
experience discontinuities for (x, f) such that xtat=km (k = integer). 


Supplementary Problems 


4.15 Determine the most general spherically symmetric solution to the three-dimensional wave equation, 
uy, — a? Vu = 0. [Hint: Find the PDE satisfied by v(z, t)=ru(v, £).] 


4.16 In Problem 4.2, let the boundary condition be replaced by 
ou : 
a(x, y, z, u(x, y, z, 2+ Bly y,z, 5 i yy, 2z,0=fOny,z,8 in § x [0, T] 
rn 


where the continuous functions @ and £ satisfy 
aB = 0 at B?>0 
in Sx [0, T]. Prove uniqueness by the energy integral method. Hint: 
av ov 


av?+ Bu —=0 —=0 
B on Beee 


50 


4.17 


4.18 


4.19 


4.20 


4,21 


4.22 


4.23 


4.24 
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(a) Differentiate under the integral sign to verify that 


°° 


F(yje er" dy 


u(x, = 
Att 7. 


satisfies u, = u,.. (b) Infer from (5) of Problem 4.7 that if F is continuous, lim u(x, t) = F(x). 


10+ 

For N a positive integer, let 

N 

un (x, 1) = >> C,e7?" sin nax O0<x<1, +>0 

neil 

Show that uy satisfies 
b= Uy O<x<1, t>0 
u(0, t)= u(1, t)=0 t>0 


for all choices of the constants C,. 


(a) Find plane wave solutions for 
Un = AF Uy, + A5uyy + b2u —-~< xX, y<ow, ¢>0 


(b) Are there any values of p for which u(x, y, t) = sin (x/a1) cos (y/az) sin pt is a (Standing wave) solution 
of the above equation? 


Consider the problem 
Un = Uxx O<x<1,0<'1<T 


u(x, 0) = u(x, T)=0 O0<x<l 

u(0, t)= u(1, t)=0 O<¢<T 
Show that if T is irrational, the only solution is u(x, f)=0; whereas if T is rational, the problem has 
infinitely many nontrivial solutions. Infer that the solution to the Dinchlet problem for the wave 
equation does not depend continuously on the data. 


Prove that the conclusions of Theorems 4.3 and 4.4 regarding the solution to u, — L[{u] = 0 continue to 
hold if we replace the hypotheses that M =0 and c(x, 1) <0 with the hypotheses that M = 0 and c(x, £) is 
bounded above (but may assume positive values). [Hint: Let c(x, 4) A, and let u(x, 1) = e“‘u(x, £).] 


Let F(x, t) denote a function which is defined and continuous for x in R*, ¢>0. For 7 a fixed positive 
parameter, let ve(x, t; 7) denote the solution of 


vn(x, = Votx, 2) xin R’, ¢>7 (1) 

v(x, 7) =0 x in R” (2) 

vo, (x, T) = F(x, 7) xin R” (3) 

Show that u(x, =| ve (x,t; 7) dt (4) 
0 

satisfies Un(x, £) = Veu(x, t)+ F(x, 0) xin R’, ¢>0 (5) 

u(x, 0) = ux, 0)=0 xin R* (6) 


This observation is known as Duhamel’s principle. 
Derive a version of Duhamel’s principle for the heat equation. 


Use Duhamel’s principle to solve 
Un = Guz + f(x) xin R', ¢>0 
u(x, 0) = u,(x, 0) = 0 x in R? 


Chapter 5 


First-Order Equations 


5.1 INTRODUCTION 


First-order PDEs are used to describe a variety of physical phenomena. 


EXAMPLE 5.1 
(a) The first-order system 
(pu)x + pr = 0 


1 
uu, + Uy = ~ — Px 


Up, + Pr = — yPux 
governs the one-dimensional adiabatic flow of an ideal gas with velocity u, density p, and pressure p. 


(b) The voltage v and current i in a transmission line satisfy the first-order system 


oi ov 

— —=~Gv 
Ox ot 
Ov Oi ; 
—+L—=-Ri 
Ox at 


where R, L, C, and G denote respectively resistance, inductance, capacitance, and leakage conductance, all 
per unit length. 


(c) Water flow with velocity v and depth u in a slightly inclined, rectangular, open channel is described by the 
first-order system 


vu, + uv, + u, = 0 
gu, t+ vv, + v, = g(So— S) 


where Sp is the bed slope, S; measures the frictional resistance to flow, and g is the gravitational 
acceleration constant. In the equations, the channel width has been taken as the unit of length. 


(a2) Population density u at time ¢ of age-a individuals satisfies the McKendrick—von Foerster equation, 
u, + Ua = —C(t, a, u) 


where c(t, a, u) represents the removal rate at time ¢ of age-a individuals. 


5.2 CLASSIFICATION 


The general quasilinear system of n first-order PDEs in n functions of two independent variables is 


7 Ou 2 OU. 
i ah ts = ous 
Diaiee | 2hime =o G=1,2,...,n) (5.1) 
7=1 val 
where a,, 6,, and c,; may depend on x, y, uy, u,...,u4,. If each a, and 6, is independent of 
uy, U,,...,u,, the system (5.1) is called almost linear. If, in addition, each c, depends linearly on 
Uj, U,,...,u,, the system is said to be linear. 


EXAMPLE 5.2 The systems of Examples 5.1(a) and (c) are quasilinear; that of (5) is linear; and that of (d) is 
almost linear. 
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In terms of the n X n matrices A= La,] and B = [b,,], and the column vectors u = (#,, 4,.-., u,)" 
and c = (c,,c,,-..,¢,)’, the system (5.1) can be expressed as 
Au, + Bu, =c¢ (5.2) 
A system of equations of the form 
a ou 
— F(u)+— =0 (5.3) 
Ox oy 


is called a conservation-law system; y usually represents a time variable. 


EXAMPLE 5.3 For the case So— S; = 0, the system of Example 5.1(c) may be written in conservation form as 
(uv), + u,=0 
(gut3v),+0,=0 
A system of equations of the form 


a a 
Pe aw G(u) = 0 (5.4) 


is said to be in divergence form. Clearly, any conservation-law system is in divergence form, with 
G(u) = u. 
EXAMPLE 5.4 The system of Example 5.1(a) is expressible in divergence form as 
(pu). + Pr = 0 
(p+ pu’), + (pu), = 0 
3 2 
( me ) -( _? ) 2 
2 y-TI/, 2 y-l/, 
If A or B is nonsingular, it is usually possible to classify system (5.2) according to type. Suppose 
det (B) ¥ 0 and define a polynomial of degree n in A by 
P(A)= det (A” — AB") = det (A— AB) 65) 


System (5.2) is classified as 


elliptic if P,(A) has no real zeros. 
hyperbolic if P,(A) has n real, distinct zeros; or if P,(A) has 1 real zeros, at least one of which 
is repeated, and the generalized eigenvalue problem (A’—AB’)t=0 yields n 
linearly independent eigenvectors t. 
parabolic if P,(A) has 7 real zeros, at Jeast one of which is repeated, and the above generalized 
eigenvalue problem yields fewer than n linearly independent eigenvectors. 


An exhaustive classification cannot be carried out when P,(A) has both real and complex zeros. Since 
a; and b, are allowed to depend on x, y, u,, %&,...,u,, the above classification may be position 
and/or solution dependent. 


EXAMPLE 5.5 
(a) All four systems of Example 5.1 are hyperbolic. 
(b) If the Cauchy-Riemann equations, uy = vy, Uy = — vx, are written in the form (5.2), then 
1 0 0 -1 
ae le-g), Bl 61 
0 1 1 0 


and P.(A)=A?+1, which has no real zeros. Thus, the Cauchy-Riemann equations are elliptic (as is 
Laplace’s equation for either u or v). 
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(c) If u satisfies the system of equations u,= v,, u, = v, then u satisfies the heat equation, u, = wy. With ¢ 
playing the role of x in (5.2), we have 


1 0 0 -1 
leah Pe 
0 0 1 O 
and P2(A)= A*. All eigenvectors corresponding to the real double root A = 0 are scalar multiples of [0, 1]’. 
Hence there is just one linearly independent eigenvector and the first-order system is parabolic. 


The method of characteristics for linear second-order PDEs (Chapter 2) may be usefully 
extended to hyperbolic, but not to elliptic or parabolic, first-order systems. For this reason, the 
remainder of this chapter will deal almost exclusively with hyperbolic systems. 


5.3 NORMAL FORM FOR HYPERBOLIC SYSTEMS 


If in (5.2), Au, + Bu, =, the coefficient matrices A and B are such that A= DB, for some 
diagonal matrix D, then the system can be written in component form as 


f du, ou 
> by (d, t+ 54) =o, (= 1,255 ,n) 
y 


wherein the ith equation involves differentiation only in a single direction—the direction dx/dy = d,,. 
We say in this case that (5.2) is in normal form. When a system is in normal form, techniques of 
ordinary differential equations become applicable to it. 


Suppose that (5.2) is hyperbolic, and let A,,A,,..., A, denote the n real! zeros of the polynomial 
(5.5). The characteristics of (5.2) are those curves in the xy-plane along which 
d 
SS GE. (5.6) 
dy 


EXAMPLE 5.6 For a linear system, the A; depend at most on x and y; so the characteristics of (5.2) can be 
determined by integrating the ordinary equations (5.6). For a quasilinear system, where the A; depend on 
Uy, U2,.-., Un, the characteristics are solution dependent. In the case that (5.2) consists of a single quasilinear 
PDE, many authors call the plane curves determined by (5.6) the characteristic base curves, and use the term 
“characteristics” or ‘characteristic curves” to denote the space curves in xyu-space whose projections on the 
xy-plane are the characteristic base curves. In this Outline we shall use ‘‘characteristics” to denote both the plane 
and the space curves; the context will make it clear which kind of curves is intended. 


Theorem 5.1: For (5.2) hyperbolic, Jet D denote the n x n diagonal matrix of the A;. Then there 
exists a nonsingular n X n matrix T satisfying 
TA = DTB (5.7) 
According to Theorem 5.1, if (5.2) is not already in norma! form, the transformed system 
TAu, + TBu, = Te (5.8) 


is in normal form, with the ith row-equation involving differentiation only in the direction of the 
tangent to the ith characteristic. Stated otherwise, a hyperbolic system can always be brought into 
normal form by taking suitable linear combinations of the equations. 


5.4 THE CAUCHY PROBLEM FOR A HYPERBOLIC SYSTEM 


The Cauchy problem (or initial value problem) for a hyperbolic system (5.2) calls for determining 
u(x,y) (i= 1,2,...,m) that satisfy (5.2) and take prescribed values (the initial data) on some 
initial curve, T. If T is nowhere tangent to a characteristic of (5.2) and if the coefficients in (5.2) are 
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continuous, the Cauchy problem is well-posed in a neighborhood of [. At the other extreme, if T 
coincides with a characteristic, then the Cauchy problem usually will be insoluble (see Problem 5.29). 

In illustration, suppose that n= 3, and let @,, ©, @, be the characteristics of (5.2) that pass 
through the point R (see Fig. 5-1). The shaded region of the xy-plane enveloped by the charac- 
teristics and the initial curve IT is called the domain of dependence of the point R; the portion of I 
between P and Q is called the interval of dependence of R. Changes in the initial data exterior to the 
interval PQ will not affect the solution at R. 


~] x 


Fig. 5-1 


Any discontinuities in the initial data are propagated away from the initial curve along the 
characteristics defined by (5.6). When the system (5.2) is nonlinear, it is possible—even for smooth 
initial data—for the solution to develop discontinuities some distance from the initial curve. These 
discontinuities occur when two characteristics carrying contradictory information about the solution 
intersect. A curve across which one or more of the u(x, y) have jump discontinuities is called a 
shock. The position of the shock and the magnitudes of the jumps in the uw, are determined by 
conservation principles (see Problem 5.17). 


Solved Problems 


5.1 Show that the open-channel flow equations, Example 5.1(c), compose a hyperbolic system and 
describe the characteristics. 


In matrix form the open-channel flow equations are 


vDouU u 1 OVfu 0 
§& v Dix 0 1 Diy &(So a) 
The charactertstic polynomial 


Pa(a)= det ([* “la [, v)) =a au 


has two real zeros, A; =v+V gu and A,z=v-—V gu. Thus, the characteristics are those curves in the 
xt-plane along which 


—=vtV gu or —=v0-Vgu 
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§.2 


5.3 


The speed (or celerity) of a small gravity-wave in shallow water of depth u is given by c = V gu. 
Making the substitution c? = gu, the open-channel flow equations become 
2uc, + cv, + 2c, = 0 
2cc, + vv, + v, = B(So- S) 
and the characteristics of this system are the curves along which 
dx ax 


= ure or egrs OF ERE 
dt dt 


Show that the characteristics of the quasilinear first-order PDE 
Bite Dit, =e (1) 
are the curves along which (1) and a knowledge of uw are insufficient uniquely to determine u, 
and u,. 
¥ 


First note that, since the only zero of a—Ab is A = a/b, the characteristics of (7) are the curves 
along which 


dx a 


dy b 
Let @: x= p(r), y = q(r) be a curve along which u is given by u = f(r). From 
u(p(r), q(r))= f(r) — along @ 
and (1), we have 
plu, + q'y = f* 
au,+ buy=c 


by which u, and u, are uniquely determined along ©, unless the determinant of the system is zero: 


P| _ p'b-q'a=0 (2) 
a b 
But (2) holds if and only if 
d 
aaP a along @ 
dy q 0b 


which is to say, if and only if @ is a characteristic of (7). 


(a) Show that the first-order quasilinear equation 
au, + bu, = c (b # 0) (1) 
is in normal form. (b) Find the canonical or characteristic equations for (1). 
(a) We know that a characteristic of (7) is defined by 
dx a dx dy 
—=— or = (2) 
dy b a b 
Calculating the derivative of u in the direction v = (a, b) tangential to the characteristic, we find 
v: Vu = (a, b)- (ux, uy) = au, + bu, 


Therefore, (7) involves differentiation in a single direction (along the characteristic); so, by 
definition, it is in normal form. 


56 


5.5 


FIRST-ORDER EQUATIONS [CHAP. 5 


(b) Let @: (x(r), y(r)) be a characteristic of (1), parameterized by r. Along @, 


x'(r)_ dx _a 


"tan (3) 
y(r) dy 6 
by (2), and u = u(x(r), y(r)). By the chain rule, (3), and (1), 
du Ou dx du dy (- ) dy cdy 
—= u,tu 
dr ax dr dy dr b "/ dr bar 
Thus, the canonical or characteristic equations for (7) can be written as 
ax d d cd 
x _ady u_cdy (4a) 
dr bar dr bar 
or symmetrically as 
dx d du 
hare Weertaakes (4b) 
a b c 
or unlinked as 
8. te] Ou 
eee a Dos b aw, (4c) 
or or or 


Form (4c) may be interpreted as indicating a change of coordinates from (x, y) to (r,s): in the new 
coordinates, the characteristics are the straight lines s = const., and (/) takes the canonical form u, = c. 


Show that a surface ¥ given by u= f(x, y) defines a solution to the quasilinear first-order 
equation 
au, + bu, = ¢ (1) 


if and only if the characteristic equations (4) of Problem 5.3 hold at each point of A In other 
words, a solution surface of (/) consists entirely of (space) characteristics, 


If f(x, y)— u = 0, then 
0= d(f(x y)— 4) = fedxt fydy— du = (fe, fy, —1)* (dx, dy, du) 
Now, if (45) of Problem 5.3 holds, the vectors (dx, dy, du) and (a, b, c) are parallel, whence 
0=(f. fy, 1): (a, 6, c) = af. + bfy —c (2) 


i.e., the function f satisfies (7). 
Conversely, if S is defined by a solution f(x, y)— u = 0 of (1), then (2) shows that at any point P of 
Sf the vector (a, b, c) is orthogonal to the surface normal (f., f,, —1).Thus, (a, b, c) represents a direction 
in the tangent plane at P; a curve @ lying in Y and passing through P in this direction will have, at P, the 
tangent vector 
(dx, dy, du) = (const.)(a, 8, c) 


But this relation is just (4b) of Problem 5.3. 


Solve the Cauchy problem 
a(x, y, uu, + B(x, y, uu, = c% y, 4) (1) 
u= u,(s) on Tt: x =F(s), y= G(s) (2) 


where, for all s, 


F"(s) | a(F(s), G(s), uals) 
G(s) b(F(s), G(s), up(s)) 


(which means that [ is nowhere tangent to a characteristic of (7)). 
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In the xy-plane, the solution process may be described as the threading of a characteristic through 
each point of the initial curve I (see Fig. 5-2). Thus, for each fixed s, imagine system (4c) of Problem 5.8 


Ox 6 ou 
ae My 7 


= = —F=C 3 
or or or = (3) 
—where the parameter r is chosen so that I is represented by r= 0—to be solved subject to the initial 
conditions 
x(0, s)= F(s) y(0, s) = G(s) u(0, 5) = uols) (4) 
u 


Characteristic £ 
x 
Fig. 5-2 
This solution will have the form 
x= x(r, 5) y=y(r,s) u= us, S) 


which are the parametric equations of a surface &. 
By Problem 5.4, ¥ is a solution surface for (1); and the conditions (4) ensure that the curve [ X uo 
lies in Y, as required by (2). Hence, if we can solve for r and s in terms of x and y, the function 


u= u(r, s)= u(r(x, y), s(2, y)) 
will solve (1)—(2). Now, it is in fact possible to invert the transformation x= x(r,s), y= y(r,s) in a 


neighborhood of I’, because, along the curve, the Jacobian does not vanish: 


Oo, 
aoe XVs — YX: = AG'(s)— bF(s) 


“2 
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Solve the quasilinear Cauchy problem 
xu, + yuu, = —xXy 
u=5 on xy=1 (x>0) 
Following Problem 5.5, we wish to solve 
X,=Xx y, = yu u, = —Xy 
subject to a 
x(0, s)=s5 y(0, s)= : u(0,s)=5 


where s > 0. By (3), 


u 
(xy), = Xy + xy, = xy + xyu u, — UU, = ( u ) 


i.e., 1+ u is an integrating factor for the equations (3), yielding 


me 
xy = SS o(s) 
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(1) 
(2) 


(3) 


(4) 


(5) 


(6) 


Now (4) implies #(s) = 37/2. Hence, solving (6) by the quadratic formula and choosing the root that 


obeys the initial condition (2), we find 


u=—-1+V38-—2xy 


The scalar conservation law [F(u)], + u, = 0 can be expressed in quasilinear form as a(u)u, + 


u, = 0, where a(u) = F'(u). Show that the solution to the initial value problem 
a(u)u, + u,=0 
u(x, 0) = u(x) 
is defined implicitly by 
u = u(x —a(u)y) 
provided 1+ uj(x — a(u)y)a’(u)y #0. 
Again following Problem 5.5, we consider the equivalent problem 
x, = a{u) y= 1 u, =0 
x(0, s)=s y(0, s)=90 u(O; s) = uols) 
Integrating the equations (4) in reverse order and applying the conditions (5), we find: 
u = Ud(s) y=r x= a(udos))rt+s 
From (6), there follows 
M = Uo(S) = Uo(x — a(uo(s))r) = uo(x — a(u)y) 


which is (3). 
The expression (3) will actually furnish the solution to (/)—(2) provided the equation 


D(x, y, u) = u— uo(x — a(u)y) = 0 
can be solved for uw as a function of x and y. The condition for solvability is 
Pu(x, y, w) = 1+ wo(x— a(u)y) a'(u)y #0 


which certainly holds for |y| sufficiently small. 


(1) 
(2) 


(3) 


(4) 
(5) 


(6) 
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5.8 


5.9 


One-dimensional, unsteady flow of a compressible fluid at constant pressure, p, is governed by 


uu, +u,=0 (1) 
(pu), + p, = 0 (2) 
(eu), + e,+ pu, =90 (3) 


where u, p, and e are, respectively, the fluid’s velocity, density, and internal energy per unit 
volume. Solve (1 )-(3) subject to the initial conditions 


u(x, 0) = u(x) p(x, 9) = py(x) e(x, 0) = e,(x) (4) 
According to Problem 5.7, the characteristics of (1) are given by 
x — ut = $= const. 


and the solution of (1) that obeys (4) is given implicitly by u = uo(s). 
Writing (2) as a linear equation in p, 


up, + p, = —uxp (5) 


we see that (5) has the same characteristics, s = const., as (1), and that along a characteristic, on which 
the running parameter is r= 6 


dp 
—_—_ Se Uy 6 
a p (6) 
Now, uz, = 46(S)s, = ug(s)(1 — fu), or 
uo(s) 
pele (7) 
1+ ud(s)t 
Substitute (7) in (6) and integrate the resulting separable equation, using the initial condition p = po(s) 
for t= 0: 
e dp at 
| — = ~ud(s) | ———— 
pols) P o i+ ug(s)t 
log a log = 
po(s) 1+ uo(s)t 
or 
pols) 
eae (8) 
1+ ud(s)t 
where s = x — ut. 
Finally, (3) and (4) yield the following problem for the new unknown E =e + p: 
uF, + EF, = ~u.E E(x, 0) = eo(x) + p 
This is formally identical to the problem for p; hence, by analogy with (8), 
€o(s) + p €o(S) = pudts)t 
=—— or e= — (9) 
1+ uo(s)t 1+ ud(s)e 


Establish Theorem 5.1. 


In component form, (5.7) reads 


n 


D (tian — Aitjbu) =O (4k =1,2,...,n) 


jel 
which is equivalent to 


[fit, fiz, - +, fin (A ~ AB) = [0,0,...,0]) (= 1,2,..., 7) (1) 
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Taking the transpose of each side of (1) yields 
(A’— A,B" )t; = 0 (i=1,2,...,7) (2) 


where t; represents the entries of the ith row of T arranged as a column vector. Now, because the system 
(5.2) is hyperbolic, there exist 1 linearly independent vectors t; satisfying the m matrix equations (2). 
Hence, the matrix T having these vectors as rows will be nonsingular and will satisfy (5.7). 


(a) Show that the system 
24, — 20+ U, = 30H v (1) 
u, — 4v, 1 DU (2) 


is hyperbolic and use Theorem 5.1 to reduce it to normal form. (b) Express the system (1)-(2) 
in terms of characteristic coordinates. 


(a) Writing (1)-(2) in the form (5.2), we have 


2h 32 1 -3 
ea) RG 
1 -4 0 1 
Since det (A— AB) = A?— A — 6 has distinct real zeros, A, = 3 and A2 = —2, the system is hyperbolic. 
According to Theorem 5.1, the rows of the normalizing matrix T satisfy 


en ae sole a Hl (be 


For i=1, A, =3, we can choose ty; = t2=1; for §=2, A2= —2, we can choose %;=1, trn= —4. 


Thus 
1 1 
te a 
1 -4 
and the transformed system, (5.8), is 
oy allele le elle lag) 
—2 14Jslol. 1 —7ilodJ, v—4u 
or 
(Bu, + u)— 230, + 0,)=v0t+4u (3) 
(-2u, + uy)— 7(-2v, + vy) = v—-4u (4) 


Equation (3) involves differentiation only in the direction 


a =3=A, (5) 
while (4) involves differentiation only in the direction 
2 =—-2=A2 (6) 
dy 
(b) From (5) and (6), the characteristics are given by 
x —3y = B =const. (7) 
x+2y = a =const. (8) 


The family (7), along which @ varies, are called the a-characteristics; similarly, the family (8) are 
called the 8-characteristics. Together, (7) and (8) define an invertible transformation from xy- to 
aB-coordinates. We have 


so that (3)-(4) transforms to 


CHAP. 5] : FIRST-ORDER EQUATIONS 61 


4 utov (9) 
Ug ~ 20g = 
5 
4du-ov 
Ug — 70, = (10) 
The system (9)-(10)-(7)-(8) constitutes the canonical or characteristic form of (1)-(2). 

5.11 With reference to Problem 5.10, solve the initial value problem 
20. tit By 30 0 (1) 
u, ~ 40, =O (2) 
u(x,0)= u(x) v0, 0) = v(x) (3) 

We know that the characteristics of (1)—-(2) are 
x—3y = B= const. and x+2y=a=const. 
and that (1)—(2) has the canonical form 

Ua — 20a = 0 (4) 
Ug — 7Tvp =0 (5S) 


If P, OQ, and R are as indicated in Fig. 5-3 and if P has coordinates (x, y), then the coordinates of Q and 
R are (x —3y, 0) and (x + 2y, 0), respectively. By (4), u— 2b is constant on the a-characteristic from Q 
to P, and, by (5), u—7v is constant on the B-characteristic from RK to P; thus, 


u(P)— 20(P) = uo(Q) — 2v0(Q) (6) 
u(P)— 7v(P) = uo(R) — 7v0(R) (7) 
Together, (6) and (7) yield the solution to the initial value problem (7 )—(2)-(3) as 


1 
u(P)= u(x, y)= 5 [7uo(x — 3y)— 14v0(x — 3y) — 2uo(x + 2y) + 14v0(x + 2y)] 


v(P)= lx, y) = = [aol By) HO 3p) tee i PTR ID 


For a hyperbolic system, a combination of the variables that remains constant along a characteristic 


is known as a Riemann invariant of the system. By the above, u—2v and u~7v are Riemann invariants 
of (1)-(2). 


Fig. 5-3 


62 


5.12 


FIRST-ORDER EQUATIONS [CHAP. 5 


Bring the open-channel flow equations, 
vu, + uv, + u, = 0 (1) 
gu, + vv, + v, = B(S)— S) (2) 
into canonical form. 
In Problem 5.1, the system (J )-(2) was shown to be hyperbolic, with characteristics given by 


dx ax 
meee ee ee qos ee (3) 
f f 


By (2) of Problem 5.9, a matrix T = [4,] that will transform (J )-(2) to normal form satisfies 
—A; ti 0 
Pe elle Gl “ee ) 
u oo A 2 0 
From (3)-(4), we may take 


hy=1 ho = Vulg b,=1 Im = —Vu/g 


Now, writing (7 )—(2) in matrix form (5.2) and multiplying by T, we find the normal equations 


(Aux + us) + Vu/g (Aros + 0) = Vug(So~ S;) (5) 
(Aoty + ue) — Vu/g(Aavx + v,) = Vug(S;- So) (6) 


To introduce characteristic coordinates, let the respective solutions to the two ordinary equations 
(3) be 


F(x, t) = B = const. G(x, t) = a = const. (7) 


i.e., the a@-characteristics and the #-characteristics. To show that (7) defines a locally invertible 
coordinate transformation, compute the Jacobian 


d(@, B)_ a(x4 t)\7! 
a(x, t) —\d(a, B) 


G, G, 
F. OF; 


| = GF, — F.G, 


But, using (3), 
aF 
0=— =F,+ F,(ut+ V gu) 


dt 8) 
dG ( 
rae G+ Gy(v — V gu) 
from which it follows that 
d(a, 
8) _oeG.Van 
a(x, 8) 
which is finite and nonzero (recall that u represents the depth of fluid). 
Thus, in terms of the new coordinates a and 8, equations (3) become 
Xe = (v+ Vv GU) be Xp =(v- V gu)le (9) 
To transform (5), we find, using the first equation (8), 
A ae (ALG, + G) i 10 
as SS at )— 
‘ox at dex um 


From the second equation (7), Gix%e+ Gita = 1. Combining this with the first equation (9) and 
substituting in (70), we obtain 
0 60 120 
At 
Ox Of ty Oa 


so that (5) goes into 
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od 


Ua + V ul g va = V gu(So~ S;)bex (11) 
Similarly, we find for the transformation of (6): 

ug ~ Vulgrs = V gu(S;— Solis (12) 
Equations (11), (12), and (9) make up the canonical form of (1)-(2). 


(a) Show that v+2c and v—2ce, where c= Vgu, are Riemann invariants (Problem 5.11) of 
the open-channel flow equations, provided S,— S,=0 (the conservation-law case). (b) Prove 
that if a single characteristic of the open-channel equations is a straight line, then (i) the entire 
family that includes that characteristic consists of straight lines; (ii) the Riemann invariant 
associated with the other family of characteristics is an absolute constant. 


(a) In terms of ¢ and v, (11) and (12) of Problem 5.12 read, after cancellation of c/g, 
2a + Va = 0 2¢a ~ vg = 0 


which imply that vo+2c is constant on an a-characteristic and v—2c¢ is constant on a B- 
characteristic. 


(b) Suppose that the particular @-characteristic F(x, £)= Bo is a straight line. Then, by (3) of Problem 
5:12? 


dx 
—=v+cC=const. 
dt 


along that characteristic. But, by (a), v +2c = const. along that same characteristic. Hence v and c 
must be separately constant along the characteristic F(x, £) = Bo; i.e., in terms of Fig. 5-4, 


v(R) = v(S) and c(R)= c(S) (1) 
On the a-characteristic F(x, t) = Bi we have, by (a), 
v(P)+ 2c(P) = v(Q)+ 2¢(Q) (2) 
while, on the 6-characteristics, we have, by (a), 
v(P)— 2¢c(P) = v(R)—2c(R) (3) 
v(Q)-- 2c(Q) = v(S)- 2¢(S) (4) 


Fig. 5-4 
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By (7), the right side of (3) equals the right side of (4); so 
v(P)— 2c(P) = v(Q)- 2¢(Q) (5) 
(i) Together, (2) and (S$) imply v(P) = v(Q) and c(P)= c(Q); hence, on F(x, 8) = Bi, 


dx dx 
— (P)= v(P)+ c(P) = v(Q)+ ¢(Q) = — (Q) 
dl at 


which shows that characteristic also to be a straight line. (11) Together, (3) and (5) imply 
v(Q)— 2¢(Q) = v(R)- 2¢e(R) 


i.e., the Riemann invariant v — 2c has the same value at two arbitrary points of the plane, Q and R. 
This result in effect removes one unknown from the problem. 


§.14. Ariver flows at a uniform depth of 2 meters and a velocity of 1 m/s into an ocean bay. Because of 
the tide, the water level in the bay, initially the same as the river level, falls at the rate of 0.15 m/h 
for 8 hours. Neglecting bed slope and frictional resistance, determine (a) at what distance 
upstream the river level is just beginning to fall at the end of the 8-hour period, (6) the velocity of 
the water entering the bay, (c) at what time the river level will have fallen 0.6 m at astation 5 km 
upstiream from the bay. 


The notation and results of Problems 5.12 and 5.13 will be used. The acceleration of gravity is 
g =98 m/s’. 


(a) The f-characteristic bordering the zone of quiet (Fig. 5-5) is the straight line 


d. = 
- = v(0, 0) c(0, 0) = (1— V9.8 X 2) m/s = -12.3 km/h (1) 
t 


Thus, after 8 hours, the discontinuity in u, has been propagated (8h)(12.3 km/h) = 98.4 km 
upstream. 
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In view of (1) and Problem 5.13(5), all @-characteristics are straight lines, and 


v(x, t)+ 2e(%, £) = v(0, 0) + 2c(0, 0) = 9.9 m/s (2) 
for all x and ¢ Thus, in units of m/s, 
v(0, t)= 9.9~2¢(0, t) = 9.9-2V9.8(2- 0.151) (3) 
At the outlet, x = 0, the water level will have fallen by 0.6 m (from 2 m to 1.4 m) at time 
pe 0.6m 
0.15 m/h 


We know from Problem 5.13(b) that v and ¢ (or uw) are separately constant along each B- 
characteristic. Hence, the 8-characteristic through (0,4), which carries the value u= 1.4m, will 
have slope 


v(0, 4) — (0, 4) = [9.9 — 2V'9.8(1.4)] — V9.8(1.4) 
= —].2 m/s = —4.3 km/h 
where (3) was used to evaluate v(0, 4). It follows that an additional time 


- 5km 7 
~ 4.3km/h 


fy 


must pass before the value u = 1.4 m is felt Skm upstream. The total time is thus f+ ¢, = 5.2 h. 


5.15 Let © be the region x,<x<x,, t)<t<zt, and suppose that in O 


a= («,(, 1), w(x, 0,..., 4,04 2) 


solves the divergence-form first-order equation 


te) te) 
— F(u) + — Glu) = 0 
= Flu) + Gu) (1) 


For any smooth function @ on 22 which vanishes on the boundary of Q, show that 


[J ee, + Gu)¢,| drar=o (2) 


From [F(u) ¢], = [F(@)].¢@ + F(u) dx and ¢ = 0 for x = x1 and x = x2, we have 


[ [ree dca=-["[ reye.acat (3) 
bac filles 


Similarly, since @ = 0 for r= ¢; and t= fa, 


x2 2 x2 2 12 x2 
| | [G(u)],¢ dt dx = — | i G(u)¢, dt dx = — il G(u) 6, dx dt (4) 
x} t xi ty ty x] 


Now, multiplying (1) by ¢, integrating over Q, and applying (3) and (4), we obtain (2). 


Smooth (C”) functions @ which vanish in a neighborhood of (and not merely on) the boundary of 2. are 


called test functions on 2. We say that wis a weak solution of (1) in Q if (2) is valid for all test functions @ on 
Q. Since (2) does not impose any continuity requirements on u, it is possible for a weak solution of (1) to 
have discontinuities. 


5.16 Refer to Problem 5.15. Let the rectangular region (2 be partitioned into regions 2M, and £2, by 
the curve f: x = o(Z), as indicated in Fig. 5-6. Suppose that u is a weak solution in Q, but a 
continuously differentiable, bounded solution in 0, and in {2,. Show that along ¥ within ©, 


(F,— F) = (G,- Ga") (1) 
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(x2, f2) 


h (x1, 4) 


Sf: x=alt) 


xy X2 x 


Fig. 5-6 
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where the subscripts | and 2 denote respectively the limits as (x, t)> S through regions , and N.. 


Because u is a weak solution in Q, we have, for any test function ¢ on Q, 


0= | | Fi. + Gd) dvar= | | (Fb. + Gb,)axar+| | (Fo, + Gd) dx dt 
1 2 


Since ¢@ vanishes on the boundary of 0, 


jae Fo, dx dt = I. [1 — F,] dx dt = lf Fig dt -| Fo dx dt 


ay 
x2 2 
i G¢, dx dt = | | [(Gd), — Gb] at dx = -| Gib dx -| Gib dx dt 
Qy xy Yom lx) ¥ ay 


Adding (3) and (4), and recalling that (7) of Problem 5.15 holds in 04, we see that 
| (Fas 2 Ga axae= | bth aL Cds) 
ay ¥ 
Similar calculations on Q, show that 
a (Fé, + Gd,) dx dt -{ ob (—F, di+ Gz dx) 
ny f 
By (2), the left sides of (5) and (6) sum to zero, whence 
2 
0 = i to) [((Fi- F2) dit+ (G2- G;) ax] = i &b [Fi = Fy) + (G2 = G,)o'(t)] dt 
f ti 


Because ¢ takes arbitrary values along ¥, (7) implies (7). 


If the curve ¥ represents a shock in the weak solution u, then o’(¢) is the velocity of the shock. 


(2) 


(3) 


(4) 


(6) 


(7) 


5.17. Use Problem 5.16 to derive jump conditions which must hold across a shock in the solution of 


the conservative open-channel] flow equations. 
The equations can be put in the divergence form 


(uv), + u, =0 


(1) 
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(uo? + e) + (uv), = 0 (2) 


x 


(this is not the conservation form, Example 5.3). Hence, by (1) of Problem 5.16, we have across a bore or 
surge Ff: x = a(t) 


U,V, — U2d2 = (Ur ~ U2) a"(t) (3) 


2 
(urvi =) (u2034 = (uyv, — U2v2)0'(t) (4) 


Assuming unit channel width and constant density, (3) asserts that mass is conserved, and (4) that 
momentum is conserved, across ¥ In the case o'(t)=0, the conditions reduce to the well-known 
hydraulic jump equations. 


5.18 Water flows in a (one-meter-wide) rectangular channel at a depth of 1 m, with a velocity of 
2 m/s. At x =0 the depth of the water is suddenly raised to, and subsequently maintained at, 
2m. Neglecting frictional resistance and bed slope, calculate the rate at which the surge moves 
down the channel and the velocity of the water behind the surge. 


In the notation of Problems 5.16 and 5.17, we have the weak solution 


behind the surge (0S x <o(f): u=u=2m, v=Yy, 
ahead of the surge (x > a(t): u='Ww=1mM, v= v2=2 m/s 


The jump conditions (3)—(4) of Problem 5.17 become two simultaneous equations in the two unknowns 


v, and o'(t). Solving (with g = 9.8 m/s’), we find: 
vy = 4.07 m/s o'(t) = 6.14 m/s 


5.19 Use the method of characteristics to solve the initial value problem 


uu, + u,=0 (1) 
1 x=0 

u(x, 0) = Lx, O<x<1 (2) 
0 x2] 


The characteristics are the straight lines 


dx 3 
— = u=const. 
dt i 
Using (2), the characteristics are constructed as in Fig. 5-7(a). 
It is seen that points (x, 1) below D—that is, in the strip << 1—lie on just one characteristic. Thus, 
on x s¢<1,u=1; andon x2=1>4 u=0. In between, on the triangular domain isolated in Fig. 5-7(b), 
integration of (3) gives 


1-x 
x= utt+ (l-u) or u= (4) 

1-¢ 

where the x-intercept was found from (2). In summary, 
{1 XS! 
y 1-x 
for t<1 u= Fa t<x<l 

~1 
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5.20 


5.21 
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Fig. 5-7 


In the strip ¢=1, points (x, £) of the shaded region in Fig. 5-7(a) lie on two characteristics which 
bear distinct values of u. The jump condition (/) of Problem 5.16 leads to the equation x = (4+ 1)/2 for 
the actual shock; i.e., the shock is the prolongation through D of the 45° characteristic. Consequently, 


] 1)/2 
for t=1 =| ee 


0 x>(e+1)2 


Show that for u = f(x/t) to be a nonconstant solution of u, + a(u)u, = 0, f must be the inverse 
of the function a. 


If u = f(x/s), 
wer) wd wee (8-2 
Hence, u, + a(u)u, = 0 impiies that 
Pye UGG 


or, assuming f’ #0 to rule out the constant solution, that 


dG ar 


This shows the functions a and f to be inverses of each other. 


Solve the initial-boundary value problem 


u, t+ e“u, = 0 x>0, 1>0 (1) 
u(x, 0) = 2 x>0 (2) 
u(0, t)= 1 t>0 (3) 


Since the characteristics of (1) are defined by 


dx 
— =e" =const. 
dt 
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the characteristics from the positive x-axis have the form x = e74+ const., and the characteristics through 
the positive f-axis are x = ef + const. Therefore (see Fig. 5-8), u = 2 for x = et, and u=1 for x Set. In 
the region et <x < e7#, where there are no characteristics, we avail ourselves of the solution u = log (x/t) 
found in Problem 5.20. It can be shown that 


I O<x<e 
u(x, )=) log (x/t) et<x<e7t 
2 ersx 


is the unique continuous weak solution of (1)-(3). 


Fig. 5-8 


Supplementary Problems 


5.22. The Euler equations for steady, isentropic, inviscid, two-dimensional, fluid flow are 


pu, + up, + pu, + upy = 0 
PUL, + poly + C’p, = 0 
puv, + pvr, + c’p, = 0 


Classify this system. 


5.23. (a) Show that one-way vehicular traffic obeys the continuity equation of fluid dynamics, 
pr + (up), = 0 


where p = vehicles per unit length, v =speed. (b) If v = v(p), show that p is constant for an observer 
at x = x(t) who moves so that 


dx d(pv) 
dt dp 


(c) Show that if v = v(p) and v'(p) <0, then the rate of propagation of small variations in density cannot 
exceed the speed of an individual vehicle at that density. (d) If v = v(p), with what speed ts a shock 
propagated? 
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5.24 The one-dimensional adiabatic flow equations are 
1 
(pu), +p, = 0 uu, + Ue = ~ — Px p= Ap’ (1) 
p 


where A and y > 1 are constants. (a) Letting c* = dp/dp, reduce (1) to 
(pu). + p. = 0 pu, + puu, + cp, =0 (2) 


and show that (2) is a hyperbolic system. (b) Transform (2) to the canonical form 


Cc Cc 
Xe = (utc), Xp = (u-c)lz Ua + — Pa = 9 Ug — — pp = 0 
p 


c (<) 
— pa = 
p yl. 


and conclude that u + 2c/(y — 1) are Riemann invariants for this problem. 


(c) Show that 


5.25 (a) Solve xu, + yu, =0 subject to the initial condition u(x, 1)= f(x), f continuous. (b) If f’ is dis- 
continuous at the single point x = x, at what points will u fail to be continuously differentiable? 


5.26 For the PDEs (a) yu,—xu,=0, (b) yu, — xu, = u, give equations for the characteristic through the 
point (x, y, 4) = (1,0, 2). [Hint for (b): Show that 


aG)- 6) 


2 


along a characteristic. ] 
5.27. Solve the Cauchy problems 


(a) U, + Ug = — 


t>0, 0<a<L 
L-a 
u(t, 0) = b(t) t>0 
where c and L are positive constants 
(b) Xu, + yu, = 1 x>0, y>0 
u=x*+y 0<x=l1-y<l 


5.28 Solve by the method of characteristics (c = const.): 
(a) uy + cur = b(x, ¢) (6) fly)us t+ uy = cu 
u(x, 0) = Y(x) u(x, 0) = g(x) 


§.29 Show that the Cauchy problem u, + u, = 1, u(x, x) = x’, does not have a solution. 


5.30 Show that the Cauchy problem yu, +xu,=cu (c= const.), u(x, x) = f(x), can have a solution only if 
f(x) = bx° (b=const.). If f has the required form, show that 


ue (2) eer y’) 


is a solution for any function g such that g(0)= b. 


5.31 Solve the initial value problems 
(a) Au, — 6v, + u, = 0 (b) 3u, + 2v, + uy + vy, =0 
u, — 30, + v, = 0 Su, + 2v,— uy + vy =0 
u(x, 0) = sin x v(x, 0) = cos x u(x, 0) = sin x v(x, 0) = e* 
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5.32 


5.34 


Refer to Problem 5.23, assuming the speed-density law 


v=v(1-2) 


where V and R denote, respectively, the maximum speed and the maximum density. Suppose that cars 
are traveling along a single-lane road (no passing) at uniform density R/3 and uniform speed 2V/3. At 
time ¢ = 0, a truck enters the road at x = 0, inserting itself just behind car A and just ahead of car B. The 
truck travels at speed V/3 until it reaches x = L, where it leaves the road (at time f= 3L/V). Make a 
graphical determination of p(x, 1), for t<? and all x, by locating the three shocks in the flow and 
applying the appropriate jump condition across them. Also find the time at which car B catches up with 


car A. 


In a horizontal, rectangular channel of unit width, water of depth uo is held behind a vertical wall. At 
time ¢ = 0 the wall is set in motion with velocity w into the standing water. Show that the shock velocity, 
W, and the depth behind the shock, U, are determined by 


Uo W-w 2 


U- 
Hiya! si.) 


(a) Show that the initial value problem 


uu, + u, = 0 


1 O<x<1 
u(x, 0)= { 
0 x<0O or x>1 
admits two weak solutions 
ie x< 4/2 
v(x, f)=4 1 2<x<14+4/2 
Ie3 x>1+2/2 
0 x<0 
eae x/t O<x<r 
ics Le 1 t<x<]4+7/2 
0 x>14+4/2 


(6) For a unique weak solution, the inequalities 
4, >a'(t)> uw 


must hold along any shock x = a(t). Verify that w, but not », satisfies these inequalities. 


Chapter 6 


Eigenfunction Expansions and 
Integral Transforms: Theory 


6.1 FOURIER SERIES 


Let F(x) be an arbitrary function defined in (—@ @). The infinite trigonometric series 


3a, + >, @, cos (nx/¢) + b, sin (nax/€) (6.1) 


n=] 


is called the Fourier series for F(x) if the coefficients a, and b, are given by 
Le digs 
a,=5 | Fa couGianieias b,=5 i Fsin CaO (6.2) 
-é -é 


in which case the coefficients are known as the Fourier coefficients for F(x). 

Since each of the trigonometric functions in the Fourier series for F(x) is periodic of period 2, it 
follows that if the series actually converges to F(x) for -€<x<, then it converges to the 
2¢-periodic extension of F(x), 

F(x)= Fx) (-@<x<@) and = F(x) = F(x +20) (6.3) 
for ali x in the domain of F; see Problem 6.3. 

Theorem 6.1 states sufficient conditions for the convergence of a Fourier series, in terms of 
properties of F(x). These, of course, derive from properties of F(x), as discussed in Problem 6.3. 
Recall that a function is piecewise or sectionally continuous in (—®, ©) if it has at most finitely many 
finite jump discontinuities in any interval of finite length. 

Theorem 6.1: Let F(x) be defined in(-@ @) and let F(x) denote the 2¢-periodic extension of F(x). 
(i) If F(x) and F’(x) are both sectionally continuous, the Fourier series for F(x) 
converges pointwise to F(x) at each point where F(x) is continuous. At each xp 
where F(x) has a jump discontinuity, the series converges to the average of the 
left- and right-hand limits of F(x) at x. 
(ii) If F(x) is continuous and F'(x) is sectionally continuous, the Fourier series for 
F(x) converges uniformly to F(x). 
(iii) If F(x) is in C? and if F°*?(x) is sectionally continuous, the series obtained by 
differentiating the Fourier series for F(x) termwise j times (j= 0,1,...,P) 
converges uniformly to F(x). 


6.2 GENERALIZED FOURIER SERIES 


To extend the notion of Fourier series to other than trigonometric expansions, we first recall the 
usual definition of the inner product of two vectors in R”: 


X*y OF (X,Y) =X, + Kyoto + Xv (6.4) 


A set of vectors {x,,...,X,} in R™ is an orthogonal family if (x, x =Ofori¥j GJ=1,..-, M); it 
is an orthonormal family tf 
0 ix~j 


6.5 
1 isj sill 


Mae Oy | 
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Clearly, an orthogonal family of nonzero vectors can always be made into an orthonormal family by 
dividing each vector x, by its norm, |\x,|| = (x, x,)"”. 


Definition: An orthogonal family is complete in R” if the only vector orthogonal to every member of the 
family is the zero vector. 


Theorem 6.2: Any complete orthonormal family {x,,...,%,,} is a basis of R™ (i.e., M = N) in terms 
of which an arbitrary vector v has the representation 
N 
v= > W,x,)x, (6.6) 
s=1 


The coefficients c, = (v,x,) in (6.6) are such that the Pythagorean relation 
N 
WP = De, (6.7) 
n=l 


holds when R” is referred to the orthonormal basis {x, }. It is the formal resemblance of the right side 
of (6.6) to the Nth partial sum of the Fourier series (6.1 )—(6.2) that serves as the springboard for the 
generalization that follows. 

Let F(x) denote a function which is defined in (a, b) and satisfies 


b 
F(x) dx <0 (6.8) 


The collection of all such functions will be denoted by L’(a, b). Two elements, F and G, are said to 


be equal in the L’(a, b)-sense if 
b 


| [F(x)- G(x) dx = 0 
This concept of equality is used to define what is meant by the convergence of an infinite series of 
L’(a, b)-functions: F(x) + F(x) +--+ converges to the limit F(x) in L*(a, b) if 
b N 2 

lim | [ Fix)- S F(x) | dx=0- (6.9) 

NWO 7 g i=] 
(This kind of convergence is frequently referred to as mean-square convergence.) 

With the introduction of an inner product, 


& 
(F G)= ) F(x)G(x) dx (6.10) 


(which is well defined by virtue of Problem 6.16), L’(a,b) becomes an inner product space. 
Orthogonality, normality, and completeness are defined exactly as in R*. In L’(a, 6), a complete 
orthonormal family is necessarily infinite, but an infinite orthonormal family is not necessarily 
complete. 


EXAMPLE 6.1 In L*(-@ &), neither of the infinite orthonormal! families 


1 am 1 | 2ax ] 3x \ 
: sin sou 
WE AL AEE a Ng 
| 1 1 mx =o 27x | 
; -COS—, - cos 
MIE NE EO Ye 4 
is complete; for instance, for F(x) =1, 


(1 1. ms 1 I. pe i ee ee 
' sin sin = n=1,2,3,... 
VPP é 
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However, the union of these two families is a complete orthonormal family, and it generates the Fourier series 
(6.1) for a square-integrable functio:. F(x). 


Analogous to Theorem 6.2 we have 


Theorem 6.3: lf {u,(x)}, n= 1,2,..., is a complete orthonormal family in L’(a, b), then for arbi- 
trary F(x) in L’(a, b), 


PORT Ca iu® (6.11) 


[mean-square convergence of the series to F(x)]. 


The analog to (6.7) 
IF(Q)P => F2 [ordinary convergence] (6.12) 
n=l 


is called the Parseval relation. 

There remains the problem of finding (nontrigonometric) complete orthonormal families for the 
construction of generalized Fourier series (6.11). The next section will show that such families arise 
naturally as the solutions to certain boundary value problems for ordinary differential equations. 


6.3 STURM-LIOUVILLE PROBLEMS; EIGENFUNCTION EXPANSIONS 
Consider the following boundary value problem for the unknown function w(x): 


—(POx)w'(X)Y + aa)w(x) = Ar(x)w(x) a <x <b 

C,w(a)+ Ciw'(a) = 0 (6.13) 

Cyw(b) + Cyw'(b) =0 
If (1) p(x), p’(x), q(x), and r(x) are continuous in (a, b); (2) p(x) >0 and r(x)>0 on fa, 5); and 
(3) Ci+C>#0, Cj+C7#0, then (6.13) constitutes a Sturm—Liouville problem. The function 
w(x) =0 is a trivial solution to any Sturm—Liouville problem. In addition, for certain values of the 
parameter A, there exist nontrivial solutions. Each value of A for which a nontrivial solution exists is 
called an eigenvalue of the problem, and the corresponding nontrivial solution is called an eigen- 
function. 


Theorem 6.4: The eigenvalues and eigenfunctions of a Sturm—Liouville problem have the following 
properties. 
(i) All eigenvalues are real and compose a countably infinite collection satisfying 
A, SAAS SA, Om, 


(ii) To each eigenvalue A, there corresponds only one independent eigenfunction 


w,,(x). 
(iii) Relative to the inner product (6.10), the weighted eigenfunctions 
V r(x) 
u, (x)= LOG). | BI (6.14) 
IV r(x) w,,@o)]| 


compose a complete orthonormal family in L’(a, b). 


An eigenfunction expansion—i.e., a generalized Fourier series for an L’(a, b)-function F based on 
the family (6.14)—not only converges in the mean-square sense (Theorem 6.3), but also: 
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Theorem 6.5: (i) If F and F’ are both sectionally continuous in (a, 6), then the series converges 
pointwise to the value [F(x+)+ F(x—)]/2 at each x in (a, b). 
(ii) If F and F’ are continuous in (a, 6), if F” is sectionally continuous, and if F 
satisfies the boundary conditions of the Sturm—Liouville problem (6.13), then 
the series converges uniformly to F(x) in (a, 5). 


6.4 FOURIER AND LAPLACE INTEGRAL TRANSFORMS 


“nny 


Theorem 6.4(i) and (iii) also nold for the eigenvalues n = 0, 1,2,... and eigenfunctions {e of 
the problem 
w"(x) = Aw(x) —aw<x<an 
w(— 1) = w(sr) 
w'(—1a) = w'(7r) 
which is of Sturm-Liouville type, except for the boundary conditions, which are periodic instead of 
separated. Thus, for arbitrary f(x) in L’(— 7, 7), we have (cf. (6.9)) 


lim | Lflx) — f(x)? dx = 0 (6.15a) 
Now S_ 7 
7 N 
nee fos Se” (6.15b) 
n=-N 
1 am : 
and pe oral Roe aes. 00 ee (6.15c) 
WT? og 


Now suppose that f(x) is in L7(—~, ©). Unless f(x) is identically zero, it is not periodic and an 
eigenfunction expansion like (6.15) cannot be valid. However, in this case we have 


lim [ | f(x) ~ fy(x)P ax = 0 (6.16a) 

where Fy(x) | F(a) ee da (6.16b) 
ie as - 

afta Fae al f(x) 7 dx (6.16c) 


Note the analogy between (6.15) and (6.16). The function F(a) defined in (6.16c) is called the 
Fourier (integral) transform of f(x); we shall indicate the relationship between the two functions as 


Fi f(x)} = Fla) or F'{F(a)} = f(x) 


Operational properties of the Fourier transform are listed in Table 6-1. In addition, Table 6-2 gives a 
number of specific functions and their Fourier transforms. For our purposes, inversion of the Fourier 
transform will be carried out by using Table 6-2 as a dictionary, together with certain of the 
properties from Table 6-1. Note that line 7 of Table 6-1 is equivalent to the inversion formula 


[ Plaje™ da = 7x) (6.17) 


co) 


The function f*g defined in line 8 is called the convolution of the functions f and g. Clearly, the 
convolution operation is symmetric, associative, and distributive with respect to addition. 
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Table 6-1. Properties of the Fourier Transform 


ee 
flx) Fla)=5—| fixe" dx 


1 f(x) (ia )"F (a) 


x" f(x) i" F(a) 


e“* F(a) (c = const.) 


f(x-¢) 


F(a-c) (c = const.) 


. a f(x) 


CiFi(a) + C2F2(a) 


Ci fi(x) + Co falx) 


flex) Icl- F(a/c) (c = const.) 


1 
F(x) rm a? 


feax)= | fle- yg) dy | 2nFla)Gla) 


Table 6-2. Fourier Transform Pairs 


Se 
1 f° . 
fiz) Fla)= =| fixe de 


(4acy e727" (e > 0) 


A/a 


ge 


vie ve” 


1 |Ix|<A sin A@ 
0 lIx|>A Ta 


L(x) = | 


2sin Ax 


(Re a > 0) 


The Fourier transform, as described here, applies to functions f(x) in L’(-~,*). A related 
integral transform, called the Laplace transform, is defined by 


LpO= | fe" dr= fls) (6.18) 


This transform may be applied to functions f(t) which are defined for -»< ¢< © and satisfy f(t)=0 


Table 6-3. Properties of the Laplace Transform 


fls)= [ f(t)en* at 


Cftt) + Gf) Ci fils) + C2fals) 


. flat) a~'f(s/a) (a>0) 


» fe) s"f(s)— 5"? f(O)— ++ — f"-P0) 
(n=1,2,...) 


ety C1 fs) 


e“f(t) f(s—c) (c = const.) 


ee ee eee 
H(1— b)f(t—b), where e*f(s) (b> 0) 
0 t<0 


. feg(Q= i flt-—r)e(r) dr | flsyé(s) 


Table 6-4. Laplace Transform Pairs 


fis)= ia fie de 


ee 
Vat 


Vat 


. erfe(k/2V1), where 


7 er 
erfe z =— | edu 
VWs 
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for t <0. Note that f(t) need not belong to L’(—, ~); it is sufficient that there exist positive constants 
M and }b such that 


[f()|= Me" for t>0 (6.19) 


Table 6-3 lists operational formulas for the Laplace transform, and Table 6-4 gives Laplace 
transforms of specific functions. 


Solved Problems 


6.1 Let f(x) be a sectionally continuous function in (0, @). Determine (a) the Fourier cosine series, 
(b) the Fourier sine series, for f(x). 


(a) Define 


_ f(x) O<x<@ 
f(x) <x <0 


an even function in (~@ @). The Fourier coefficients of F(x) are given by (6.2) as: 
2 € 
an = =| f(x) cos (nx/€) dx b, = 0 
GQ 


With these coefficients, the series (6.1) represents, for all x, the function F(x), the even 2¢-periodic 
extension of f(x). 


(b) Define 


f(x) O<x<@ 


Fel ey -€<x<0 


an odd function in (-@, @). The Fourier coefficients of F(x) are given by (6.2) as: 
2 é 
a, = 0 b, = Al f(x) sin (nax/ 0) dx 
Q 


With these coefficients, the series (6.1) represents, for all x, the function F,(x), the odd 2€-periodic 
extension of f(x). 


6.2 Find all eigenvalues and eigenfunctions for the problem 


—w"(x) = Aw(x) O<x< 
w’(0) = w'(@) =0 


As this problem is of Sturm—Liouville type, Theorem 6.4(i) ensures that the eigenvalues A are 
real—negative, zero, or positive. Each of the three possibilities for A leads to a different form of the 
general solution to the differential equation, and we must then check to see which solution(s) can satisfy 
the homogeneous boundary conditions without reducing to the trivial solution. 

If A <0, write A = —y? <0. Then w(x) = Ae“* + Be™**, and the boundary conditions, 


w'(0) = 4(A- B)=0 w'(0) = w(Ae*’ — Be“*) =0 


are satisfied if and only if A= B=0;1.e., there are no negative eigenvalues. 
If A = 60, then w(x) = Ax + B, and the boundary conditions, 


w'(0)= A=0 w(0)=A=0 
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6.4 


6.5 


are satisfied by w(x)= B #0. Thus, A =0 is an eigenvalue, and all corresponding eigenfunctions are 
constant multiples of wo(x) = 1. 
If A> 0, write A =? >0. Then w(x)= A sin wx + B cos px, and 
w’(0) = pA = 0 
w'(€) = wAcos wé— vB sin ul =0 
The determinant of this system, —u?sin ug vanishes for p,=nn/€ (n= +1,+2,...). Hence, the 
positive eigenvalues are A, =(na/€ (n= 1,2,...), and the eigenfunctions corresponding to A,, all are 
constant multiples of w,(x)= cos nax/@. 
It is seen that the eigenfunction expansion on (0, @) yielded by the above Sturm—Liouville problem is 
nothing other than the Fourier cosine series of Problem 6.1(a@). Changing the boundary conditions to 
w(0)= w(@) = 0 would yield the Fourier sine series. 


Given a function F(x), defined on the closed interval [-@ @], state conditions sufficient to 
ensure that F(x) is C” on the whole real axis. 


If F(x) were defined merely in (-@ €), then (6.3) would fail to define F at the points x= 
+ €,+3€ +5@,..., so that questions of continuity would be meaningless. Even if (i) F(x) is defined on 
[-@ @], the function F is well defined only if (ii) F(@)= F(—@). If (i) and (ii) hold and, in addition, 
F(x) is continuous on [—@, @], it is apparent that F(x) will be continuous for all x. 

Repeating the above argument with respect to the derivatives of F, we prove the 
Theorem: F(x) is C° if, for j=0,1,..., p, F‘?(x) is continuous on [-@ @] and obeys 


FY) = FO(- é) 


Given a function f(x), defined on the closed interval [0, ¢], state conditions sufficient to ensure 
that F\(x) [Problem 6.1(b)] is C? on the whole real axis. 


We apply the result of Problem 6.3 to the function F,(x) of Problem 6.1(5), making two preliminary 
observations: 


(1) For the odd function F,(x) to be continuous on [-@ @] and to obey F,(@)= F,(- 0), it is 
sufficient (and necessary) that f(x) be continuous on [0, @] and obey f(0) = f(@) = 0. 


(2) For odd j, the jth derivative F{?(x) is an even function in [-@ ¢]. Hence, if it exists, this 
function automatically satisfies F9?(2) = FY (-2&). 


Theorem: F,(x)is C? if f(x) is continuous on [0, ¢] for j= 0, 1,..., p, and if 


fOO)= fY(C)=0 
for k =0,2,4,...Sp. 


Show that if both f(x) and f’(x) belong to L7(—~, ~), lim f(x) = 0. 


|xl+e0 


For all values of x, [f(x)+ f’(x)|?=0, from which it follows that 


[ separ peotac=|2[ porear (1) 


for any real a and b. Now, 


2] flay (e) de = fF flay (2) 


Moreover, if both f(x) and f’(x) are square integrable, 
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lim if f(xy dx = lim | f'(xP dx =0 (3) 


boo bee 


where a and b are allowed to tend to + independently. Together, (1), (2), and (3) imply that f(x) 
approaches a constant as x approaches +o. Since f is square integrable, this constant must be zero. By 
similar reasoning, f(x) tends to zero as x tends to —~, 


6.6 Find 
go {icosha's) (b>a>0) 
s cosh bV's 
We have: 
LeoshiaV & ett ae7tY* gene yg ererivs 1 
s cosh bV's 5 eoVF4 ers s Pagers 


ela PVs 4 plates oa 


= s (-1)"e72V* 
s n=0 


= >», (c1yt 2 etenenb-alVe 4 >S (ci) 2 e-l@ntnbraive 
n=0 Ss n=0 Ss 


Then, by line 9 of Table 6-4 and the linearity of the Laplace transform, 


_cLeosh avs (2n+1)b-a = (2n+1)b+a 
yt = 1)" erfe | - 1)" erfe | —————_ 
Coane oo lag el ae 


Supplementary Problems 


6.7 Show that if a series of the form (6.1) converges uniformly to F(x) in (-@, @), the coefficients must be 
given by (6.2). 


6.8 Compute the Fourier coefficients for: 
( ) F( fF -a7<x <0 
a = 
x) 1 O<x<7 
(b) G(x)=|x{  (-m#<x<7) (c) H(x)=x (-w<x<7) 
6.9 Characterize the convergence of the Fourier series from Problem 6.8. 


6.10 Write (a) the Fourier sine series, (b) the Fourer cosine series, for the function F(x) = 1,0<x< 7. 


6.11 Find the eigenvalues and corresponding eigenfunctions of 
—w"(x) = Aw(x) O0<x<F@ 
under the boundary conditions 
(a) w(0)= w(é)=0 (d) w(0)+ w'0)= w(€)=0 
(b) w0)= w(f)=0 (e) w(0)+ w'(0)= w(é)= 0 
(c) w'(0)= w(f)=0 (f) w(0)+ aw'(0)= w(f)+ Bw(€)=0 (a >B>0) 
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6.12 


6.13 


6.14 


6.16 


6.17 


6.18 


Let {uy(x), U2(x), ... , Uas(2)} be an (incomplete) orthonormal family in L7(a, b). Given a function F(x) in 
L’(a, b), infer from the identity 


ir [F- S Cun) deaf Pe ae- 5 ({. Fund) |+ 5 (a-f Fis, dx 


2 
n=] a 
where C,..., Cy, are arbitrary constants, that 


(i) Out of all linear fittings of F(x) by the family {u,(x)}, the generalized Fourier series yields the 
smallest mean-square error. 


(ii) The generalized Fourier coefficients, F,, of F(x) obey Bessel’s inequality, 


> Fi sIFR 


Prove a theorem for F:(x) analogous to that found in Problem 6.4 for F,(x). 


Let f(x) be defined on [0, @] and satisfy, for some p = 2, the hypotheses of the theorem of Problem 6.4 
(6.13). Prove that the Fourier sine (cosine) series converges uniformly. [Hint: Integrating by parts p 
times, show that 
constant 
[dn (lax) = 


and apply the Weierstrass M-test. 


Find the Fourier series for the following functions: 


x O<x< 7/2 
(a) f(x)=47-x ml2<x <3n/2 (c) f(x) =3x? -a<x<am 
x-—20 3r/2<x< 27 


1 al2<|x-al<a 


03 a 
1 pee (d) f(x)=x Tox< aT 


(6) f={_ 


For f and g in (real) L?(a, b), show that 
(J rereerar) =(fpertax) (ace ax) 


Let {u,(x)} denote a complete orthonormal family of functions in L7(a, 6). For f,g in L7(a, 6), let 
fp =U un), Sn = (8, un) for n= 1,2,.... Prove: 


(a) (8)= 2 fnBn (c) Sfi<e 


nel 


(6) (3 fae) =(52)(5 8) (a) tim 0 


n=l net n~200 


Refer to Problem 6.17. If f belongs to L?(a, b), if f—the (b — a)-periodic extension of f—is continuous, 
and if f' is sectionally continuous, prove that 


> lfil<@ 


n=] 
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6.19 Use the operational properties of the Fourier transform (Table 6-1) to find the Fourier transforms of 


1 l<x<3 
a soe = 4 6<x <8 

fx) | 0 otherwise B(x) = os ‘ : 
0 otherwise 


6.20 If F(a) = F{f(x)}, use the convolution property of the Fourier transform to find 


F(a) 


of Fe) 
a’ + 8a 4+ 20 


6.21 Use the operational properties of the Laplace transform (Table 6-3) to find the Laplace transforms of 


0 {<1 
f(Qt)=P sin at e(t) =e" cos at g(=4 1 1<1<2 
0 2<t 


6.22 Calculate (a) ¥Ns4e7**}, (b) LUV sf(s)} if f(s) = LEO}, (c) Fo Mexp (-kV's + hy}. 


6.23. Find the inverse Laplace transforms of 
F cosh as 1 . sinhaVs 1 
(s)= = §(s)= ——=— 
sinh bs s sinh bV's V's 


Chapter 7 


Eigenfunction Expansions and 
Integral Transforms: Applications 


The techniques of Chapter 6 can yield exact solutions to certain PDEs, by reducing them to 
ordinary differential equations or even to algebraic equations. For success, it is essential that the 
PDE be linear and hence allow superposition of solutions. 


7.1 THE PRINCIPLE OF SUPERPOSITION 


Let L[ ] denote any linear partial differential operator; e.g., (3.3). Then, for arbitrary, 


sufficiently smooth functions u,,..., Ug, and arbitrary constants c,,..., Cy, 
Lieu, +--+ + ¢yuy | = ¢, Llu] +++ ++ Lf uy] (7.2) 
and so 
Ebe}=) (f= 1, -<:,N)> Leu, +*** + qyuy] = 0 (7.2) 


(7.2) is one statement of the principle of superposition. 
For infinite linear combinations such that 


D Cyl, and Dy Cx L[ uy | 

k=l 
both converge, we have 

iS a, |= bone aba (7.3) 
k=l k=l 

and the superposition principle reads: 

L[y]=0 (all K>L|> qu, |= 0 (7.4) 

k=l 


For a third version, suppose u(x, A) to be a function of x in R* depending on parameter A, 
a<A<b, and g(A) to be an integrable function of A on (a, b). Then, if 


[ ead and [ OSTA aes 
both exist, we have 
L i OSU dn = ip g(a) L[e(x, A)] da (7.5) 
and 
(EEO Gate nSk if SOE dn] =0 (7.6) 


7.2 SEPARATION OF VARIABLES 


If u(x, y) satisfies a linear PDE in x and y, then the method of separation of variables for this 
problem begins with the assumption that u(x, y) is of the form X(x) Y(y). This has the effect of 
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replacing the single PDE with two ordinary differential equations. The theory of eigenfunction 
expansions enters into the treatment of any inhomogeneous aspects of the problem. 


EXAMPLE 7.1 By examining the Solved Problems, where numerous applications of the method of eigen- 
function expansion (separation of variables) are made, we see that for the method to be successful, the problem 
must have the following attributes: 


(1) At least one of the independent variables in the problem must be restricted to a finite interval. 
Moreover, the domain of the problem must be a coordinate cel] in the coordinate system in which the 
PDE is expressed (e.g., in Cartesian coordinates, a rectangle; in polar coordinates, a sector). See 
Problem 7.17(b). 


(2) The PDE must separate; see Problem 7.17(a). 


(3) In general, homogeneous boundary conditions must be arranged such that at least one of the separated 
problems is a Sturm—Liouville problem. (If this is not the case, it can often be made so by reduction to 
subproblems or by a change of dependent variable.) See Problems 7.18 and 7.4. 


7.3 INTEGRAL TRANSFORMS 


The integral transforms which are most generally applicable are the Fourier and Laplace 
transforms. Others, such as the Hankel and Mellin transforms, are sometimes useful, but they will not be 
considered here. 


EXAMPLE 7.2 Examination of the Solved Problems reveals that integral transforms apply in the following 
situations: 


(1) The PDE has constant coefficients (otherwise the Fourier or Laplace transform would not produce an 
ordinary differential equation in the transform space). 


(2) The independent variable ranges over an unbounded interval. If the interval is (-~,), then the 
Fourier transform is the likely transform to use. If the interval is (0, ©) and, in addition, if the initial 
conditions are appropnate, then the Laplace transform is indicated. 


Solved Problems 


7.1 For f(x) in L°(0, ), find u(x, £) satisfying 


u, = KU, O0<x<@ t>0 (1) 
u(x, 0) = f(x) O<x<@ (2) 
u(0, 1) = u(é, t) = 0 t>0 (3) 
Assume that u(x, 4) = X(x) T(t). Then 
u(x, t) = X(x) T(t) Uy. (x, t) = X"(x) T(t) 
and it follows from (1) that, forO<x< @and1t>0, 

TQ) Xx 

a = vo (4) 


Since the left side of (4) is a function of ¢ alone and the right side is a function of x alone, equality holds 
for all O< x < @ and every 1 >0 if and only if there exists a constant, —A, such that 
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T(t) a= X"(x) 
«kK T(¢) X (x) 
for0<x< ¢,1>0. This is equivalent to the two separate equations, 
T’(t)= -AK T(t) and —X"(x) = AX (x) 
In addition, the boundary conditions (3) imply that X (0) = X(@) = 0. Hence, 
-—X"(x) = AX(x) 
X(0)= X(€)=0 
is a Sturm—Liouville problem, with eigenvalues A, = (na/€Y and corresponding eigenfunctions X,(x) = 
sin (nax/@) (n= 1,2,...). 


A solution of 
T'() = -AnK T(t) (@>0, n=1,2,...) 


is easily found to be T,(f)=e". Thus, for each n, un(x, 1) = e7*"" sin (n7x/@) satisfies the PDE (1) 
and the homogeneous boundary conditions (3). By the principle of superposition, the function 


u(x, = S Crm (x, f) 
n=l 


has these same properties, for any set of constants c, for which the series converges. Finally, the initial 
condition (2) will be satisfied if 


f(x) = > caun(x, 0)= >) cn sin (nax/€) 
n=l n=1 
which determines the c, as the coefficients of the Fourier sine series for f(x) (see Problem 6.1(b)): 


= =F p(x) sin (nmxl€) dx 
on =F, ; (x) sin (n7rx, 


Solve 
u(x, )= KU D+F) O<x<8 150 
u(x, 0) = f(x) 0<x<l 
u(0, )= u(@, )=0 t>0 


Because the equation here is inhomogeneous, we must use a modified separation of variables 
procedure. If F(x, 4) were zero, Problem 7.1 would give the solution as 


u(x, 1) = > Cre MO" gin (nax/C) 


n=1 


Therefore, borrowing the idea of ‘‘variation of parameters,’’ we assume a solution of the form 


oo 


u(x, 1)= >; un(t) sin (nax/€) (1) 


n=l 


for certain unknown functions u,(f); in addition, we write 


F(x, t)= S F,,(2) sin (n7x/€) f(x)= S fa sin (nax/€) (2) 
a= n=l 


where the Fourier coefficients F,(t) and f, are given by the usual integral formulas. Substituting (7) and 
(2) into the PDE yields 


SY [ui(t)+ «(na/ Of un (1) — F,(t)] sin (nax/ ) = 0 (3) 


nek 


and the initial condition becomes 
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a [u,(0) — f,} sin (narx/¢) = 0 (4) 

Because {sin (n7rx/¢)} is a complete orthogonal family in L7(0, @), (3) and (4) imply that for mn = 1,2,..., 
ui(t)+ «(nal €)un(t) = F.(t) r>0 (5) 

un(0) = fa (6) 


There are several standard techniques for solving (5) subject to (6); we choose to take the Laplace 
transform of (5), applying line 3 of Table 6-3: 
s F,(s 
ax(s)= — 2+ 20) (7) 


stx(na/[lP s+ «(niall 


Then, inverting the transform with the aid of line 7 of Table 6-3, 


' 
un(t) = fa ence | @ Klar OUT) Bry dr 
0) 


and (1) becomes 


2 


u(x )= > fren e"’™* cin (nax/0) + >, [ | eX (amlEPUKT) Be (7) ar| sin (n7x/€) (8) 
oO 


n=l nat 


The first series on the right of (S) reflects the influence of the initial state, u(x, 0); the second series 
reflects the influence of the forcing term, F(x, ¢). 


Exhibit the steady-state solution to Problem 7.2 if f(x)=0 and (a) F(x, t)= (x) (ie., 
time-independent forcing), (b) F(x, t) = (x) sin #4. For simplicity, take = 1. 


By Problem 7.2, 


u(x, t)= 2 [f er PU) Fe (7) ar| sin marx (1) 
in which 
Flr) =2 | F(x, 7) sin narx dx (n= 1,2,...) (2) 
(a) Aij=&= 2| pines. eat 
and since 


( ae eo onery 


[ eR tT) dr= 

0 K (n> 
(1) reduces to 

1 as fy 

u(x, ft) = — s+ —, i 


Kone (n7 ar) 


Letting 1, we obtain as the steady-state solution 


(1-e7"@"?") sin marx 


U(X) = . s te sin marx (3) 


Kons 1 (utr , 
Differentiating (3) twice with respect to x, 
ua(x)= —— iS &, sin nx = == 43) 
Kavi 


That is, ueo(x) satisfies the original inhomogeneous heat equation with all time dependence 
suppressed. In this sense, u(x) is an equilibrium solution. 
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1 
(b) E@aGa (2] a ayein wax dx) Seti. =a 
0 
: k(n sin t— cos t+ eo"! 
and I EW PO-D) sin 7 dr (on) ar 
0 L+ K*(n7) 
* «(ny sin £~ cos p+ ene ™! 
Hence u(x, 1) = >, sy: 5 a dn SIN NX 
et 1+ x*(n7r) 
For large t>0, u(x, £) approaches 
ry 2: 
K(nary sin £-- Cos 
U(X, t) = ~ ne) dn SIN NX 


nel 1+ «*(n7y 


Evidently, when the forcing is time dependent, the steady-state solution is also time dependent and 
cannot be obtained as the solution of a time-independent heat equation. 


Solve 
u(x, 1) = Ku, (2%, 0) O<x<€t>0 
u(x, 0) = 0 O<x<@ 
U0, )=fxlt), UEH=f()  1>0 
if fo(0) = f,(Q) = 0. 


If we attempt to separate variables directly, we shall be led to the following consequences of the 
inhomogeneous boundary conditions: 


XO) T(t) = fo(t) and X(QT() = fit) 


for ¢>0. Neither of these implies anything directly about X(0) or X(@), and as a result we do not obtain 
a Sturm—Liouville problem for X(x). 
To reduce the problem to one with homogeneous boundary conditions, let us write 


x x 
WE NESE (1 e =) fol +S fd 


The problem for v(x, ¢) is then 


u(x, t) — KU. (4, t) = F(x, 1) O<x<€ 1t>0 
v(x, 0) =0 O<x<@ 
v(0, t)= 0(6 H=0 t>0 


x x 
weve Fo, )=- (1- *) fal)- Sh 


We obtain the solution at once by setting f(x) =0 in Problem 7.2: 


had ft 


v(xy j= > | en EPU—7) Be () ar| sin (narx/@) (7) 
(0) 


net 


where the Fourier coefficients F, are given by 


Rinse “ i" [(1 . -) fo(t) + : KO| din (hax Oe 


2 
ae [(cos nar) fi(t)— fo(e)) (2) 


Rework Problem 7.4 by the Laplace transform method. 


Let a(x, s) denote the Laplace transform of u(x, ¢) with respect to 4 Then: 
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sa(x, 5)-~0= x — A(x, 5) O<x<F@ (1) 
dx 

A(0, s) = fols), a(¢, s)= fils) (2) 


With o? =s/x, sinh xo and cosh xo are two linearly independent solutions of (J). Also, sinh xo and 
sinh (@—- x)o are linearly independent solutions, and these will be more convenient for our purposes, as 
one of them vanishes at x = 0, and the other at x = @ In fact, the linear combination 


fs) sinh xo + hols) 


sinh && sinh f& 


a(x, s)= sinh (€— x)o (3) 
satisfies (7) and (2). 
Using the approach of Problem 6.6, we obtain, for b>a>0, 


sinhaVvs © 


=e -[(2n+1)b-a]Vs __ Ss e(@nt Db+alVs 
sinh Pre n=0 n=0 


so that, by line 8 of Table 6-4, 


sinhaVs) 2 (2n+1)b-a 2 (2n+1)b+ 
es se |=! n+1) enWensdonaitiar_ sy OM )bt+a 


sinhbVs? p20 4nt pa 4nf 


e lant 1)b+ a]2fae 


. (Qn+l)bt+a 


Acne: 4nt? 


Choosing 6 = @V« and a= x/Vx« or (€— x)/Vk, we obtain 


el2ntlb+ altar 


—[(2n4 +x [ant 


* ae a S (Q2n+1)€+x 
= e 
sinh fo new V4rK«e 


gy {enn (¢- a = (2n+2)€-x gent 2 e-x1/4ct 
sinh €& new W4r«e? 


From line 7 of Table 6-3, it follows that if we define 


M(x, N= Ee > e7 (ane- x/aur 


n= 


then u(x, t) can be expressed in the form 
u(x, t)= | M, (x, t— 7) fol) ar+| M,(@— x, t— 7) f(r) dr 
o iv) 


This form of the solution involves a series that converges rapidly for small values of ¢, whereas the form 
obtained by separating variables is to be preferred for large values of ¢ 


Solve 
u, (x, = Ku, (% 6) -wM<x<m, t>0 (1) 
u(x, 0) = f(x) —o< <0 (2) 
u(x, t) of exponential growth in x (3) 


This is a well-posed problem for the heat equation, with (3) playing the role of boundary conditions 
on the variable x. Under the Fourier transform with respect to x, the problem becomes: 


d 
a Um t)=-Kxa’?U(a, 1>0 


U(a, 0) = F(a) 
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of which the solution is U(a, t)= F(a) e~"*”, Inverting by use of Table 6-2, line 1, and Table 6-1, line 8, 
we obtain 


oo 


1 
a), Oe (4) 
TK —0 


It can be directly verified (see Problem 4.17) that (4) is a solution to (/)-(2)-(3), independent of 
the validity of the steps used above to construct it. In fact, it is the unique solution (cf. Problem 4.2). 


u(x, 1) = 


Solve 


u(x, 1) = Ku,(% 8) x>0, 1>0 
u(x, 0) = f(x) x>0 
u(0, t) = g(t) t>0 
lu(x, |< M x>0, 1>0 


Reduce the problem to subproblems for u,(x, t) and uo(x, t) such that u = u,+ uo. 
Subproblem 1 Up = KU, xx x>0, 1>0 
u,(x, 0) = 0 x>0 
ui(0, t)= g(t) t>0 
|ur(x, t)] <M x>0, 1>0 
Taking the Laplace transform with respect to 4, we obtain the problem 


2 


S20 Orig ae s) x>0 (1) 
41(0, 5) = &(s) (2) 
lilx, <= x>0, s>0 3) 

s 


The solution of (7) that obeys (2) and (3) is di(x, s)= &(s) exp (-xV s/«). Then, by line 8 of Table 6-4, 


(«,)=—— [4 exp[-*—] awa 
u,(x, t)= exp | — alr) dr 
; V4aK 79 (f— ry? 4n(t-7) 
Subproblem 2 Uz, (xX, t) = KU2, xx(X, f) x>0, 1>0 


u(x,0)= f(x) x>0 
u2(0, t)= 0 t>0 
u(x, 2)|< M x>0, 1>0 
Let F(x) denote the extension of f(x) as an odd function over the whole x-axis, and consider the 
problem 
v(x, t) = Kv (x, ¢) —w<x<w, 1>0 (1) 


v(x, 0) = Fo(x) -—wixca (2) 


It is obvious physically that an initially antisymmetric temperature distribution must evolve antisym- 
metrically; that is, the solution v(x.) of (7)-(2) ought to be odd in x. If it is, and in addition is 
continuous and bounded for ail x and all positive 4 then its restriction to x >0 provides the solution 
u(x, t) of subproblem 2. Now, by Problem 7.6, the unique solution of (7)-(2) is 


1 es 
os, 1)= | oO) ay 
V 4aKt “0 
1 ° ~(x- ' -(xt £ 
= ll le (x-y)t/an -e@& yt/an. lf(y) dy 
WK 0 


It is easy to see that, under mild conditions on f(y), this function possesses all the desired properties. 
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Consider the following special case of Problem 7.7: f(x) =0, g(t) = g) = const. Show that (a) 
u(x, ) = gy erfc (x/V 4x2); (b) the “front” u(x, f) = ag, (0< a <1) propagates into the region 
x >0 at speed z,V«/t, where erfc z, =a. 


(a) From Problem 7.7, 

x iF 1 x? 
exp | — 
V4ak “9 (t— ry? 4k(t—-7) 


The transformation A* = x7/4«(¢— 7) changes this to 


u(x, 2) = u(x, O= | Ro dr 


oo 


2 
u(x, y= go— | e-* da = goerfe (x/V 4x1) 
Vir xiV4ut 


(b) For 0<a@<1, let z, denote the unique solution of erfc z, =a. Then u(x, t) = ago for all x and ¢ 
that satisfy x = z,V4«t. Therefore, at time ¢>0, the point x.(t) at which u = ago moves with speed 


dx Vi 

pare eee 

dt Vt 

Solve 
u,(x, t) = a7u,,(x, t) O<x<@ t>0 (1) 
u(x, 0)= f(x), 40, 0)= g(x) O<x<? (2) 
u(0, 1) = u(t) =90 t>0 (3) 
We suppose u(x, t) = X(x)T(2) and are led to 
SOEs _xjaxeise 


X(x) a?T(t)_ 
This yields two separated problems: 


X"(x) + A? X(x) =0 O<x<@ 
X(0)= X(€)=0 
and T'(t)+ aa?*T(N=0 ¢t>0 


The respective solutions are, with A*7=A2=(n7/€Y (n=1,2,...), 


X,(x) = sin (n7x/€) 
Tn(t) = A, cos (nzrat/@) + B, sin (nzrat/@) 
Hence, 


u(x, 1) = »: A, sin (n7x/€) cos (narat/ 0) + s B, sin (nix/€) sin (nzrat/@€) 
a=} 


n=] 


Now the initial conditions (2) require 
f(x)= 3 Ansin(nmx/€) (0< x <4) 
n=l 
g(x) = > B,(n7a/é) sin (n7x/€) O<x<@) 
n=l 


These conditions will be satisfied if A, and (nza/@)B, respectively equal f, and g,, the Fourier 
sine-series coefficients of the functions f(x) and g(x). Therefore, 


u(x, 1)= s f, sin (narx/@) cos (nirat/@) + > Ene sin (n7rx/@) sin (n7rat/ @) (4) 


nxt net Nira 


By use of the relations 
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i lf. nw ont 
sin (n7x/€) cos (nzrat/@) = 5 [sin - (x4 at)+ sin a (x- at)| 


1 
sin (nix/@) sin (nzrat/ @) e | cos (x - at)— cos - (c+ at)| 


nw (**% ~~ naz 


= sin —— dz 
26 J yma € 
we can rewrite (4) as 


u(x, t)= >) fa [sin —(x+ at)+ sia — mc - at)|+5 +— S oe 8, sin = dz 


2@ n=1 


== a (F(x + at)+ F(x - at)| + i i Go(z) dz (5) 

2 2a J xa 
Evidently, as was suggested in Problem 4.14(a), the initial-boundary value problem (1)-(2)-(3) is 
equivalent to the pure initial value problem in which the initial data are the periodic functions F, and Gp. 
Indeed, for such data, separation of variables in a half-period strip has led to the same D’Alembert 
solution of the wave equation as is furnished by the method of characteristics when applied over the 
entire xf-plane. See Problem 4.10. 


7.10 Solve 
u(x, t)= au, (x,t)  -e<x<0, >0 
u(~%0)= f(x) -e@<x <0 
u(x, 0)= g(x) -e@<x<@ 


For special, periodic f and g, the solution has already been found in Problem 7.9. Here again we 
shall retrieve the D’Alembert formula. Apply the Fourier transform in x, to get 


dU (a, t) | 


°F —a’°a*U(a, t) t>0 (1) 
U(a, 0) = F(a) (2) 

dU 
ay 0) = G(a@) (3) 

f 


Solving (1), U(a, t)= Aisin aat+ Az cos aat; then (2) and (3) imply A2= F(a), Ai = G(a)/aa. Hence, 


sin aat Sinaar 1 . ; 
+ F(a) cos aat = G(a) Tigh tale ee) 
aa 


U(a, t) = G(a) 


where we have chosen to write Cos aat in the exponential form for convenience in inverting. Using 
Tables 6-1 and 6-2, we obtain: 


u(x, t)= g * = tale) +500 + at)+ f(x - at)] 
== [> ae~y) dy +5 [fe + att fle ad) 
=~ {— g(z) de +5[fx + an)+ fx at)| 


7.11 Solve 
Uu,(x, t) = a7u,,(% £) x>0, t>0 
u(x, 0) = f(x), u,(%,0)= g(x) x >0 
u(0, t) = A(t) t>0 


The approach of Problem 7.7 is perhaps best here. 
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Subproblem 1 Uy n(X, t) = a? uy x. (X, £) x>0, 1>0 
u(x, 0) = f(x), U1. (%, 0) = g(x) x>0 
u(0, 1) =0 t>0 


In the usual way, we extend the problem to x <0 by making the initial data odd functions of x; this 
(plus continuity) forces u,(0, t)= 0: 


val, 1) = a? ve(%, £) -x~< xm, t>0 
v(x, 0) = Fo(x), v(x, 0) = G,(x) -wo< xr <m@ 


Problem 7.10 gives 


J 7 xtat 
v(x, Vo lO aera at))+5- | G,(z) dz 


and so 
] J xt+at 
[fee + at) + fla an += | g(z) dz 0<t<x/a 
u(x, t) = 1 7 ware 
5 [fle + at)~ flar— 29) + 5 | g(z) dz O<x/a<t 
Subproblem 2 Ur,u(%, £) = a7 Ur 2x(%, £) x>0, 1>0 


u?(x, 0) = u2,(x, 0) =0 x>0 
420, t)= h(t) 4 >0 
Apply the Laplace transform in 4, to get 


2 
$*fin(x, s)-0= a? re fi2(x, 5) x>0 


(0, s) = h(s) 
Then, ii2(x, 5) = Ci e-*"4 + Cp e*"*, In order that u(x, ) remain bounded for all positive x and 4 we 
require that C, = 0. The initial condition then implies C, = A(s), and we have 
fio(x, 5) = A(s) e-*” 
It then follows from line 6 of Table 6-3 that 
0 O<t<x/a 
ual x, t) = | 
h(t— x/a) O<x/a<t 


Our solution, 


| J xt+ar 
= [fle + at) + for~ an += | g(z) dz O<t<x/a 
2 24) y-a 
u=u,+ w= 
1 attx 
sex + at)- flar— xy) += | g(z)dz+h(t-xfa) O<x/a<t 
GQ J ai-x 
should be compared with Fig. 7-1, the characteristic diagram. 
At x= Xo at time t= %<x%/a, the domain of dependence is the interval [xo— at, xo + ato]. 
Moreover, the backward characteristics through (x9, ia) do not meet the line x = 0 in the half-plane 1 > 0. 
Therefore, 


1 1 xptay 
U(to, a) = 5 [fla ato)+ flxo- an)]+5-[ gle) de 


x9- any 
For ¢ = t; > Xo/a, the domain of dependence of (xo, f:) is the interval [at;— Xo, at; + xo], and one of the 
backward characteristics through (X%, f,) cuts the line x =0 at ¢ = %,— (xo/a). Then, 


U(X, fh) = ; [f(ati + xo) — f(ati — xo)] +— ie g(z) dz+h(ti— xo/a) 


any~ x0 
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Xg— ath Xo - al aly—Xq Xo Xo t+ ah Xo t+ at x 


Fig. 7-1 


Solve 
U(x, £) = a’u,,(x, t) + f(x, t) x>0, ¢>0 
u(x, 0) = u,(x, 0) = 0 x>0 
u(0, t)= h(t) t>0 
In the usual way, we reduce this to two simpler subproblems with solutions such that u = u,+ Ue. 
Subproblem | ura(X, t) = a7 Ut, x(x, £) x>0, t>0 


u1(x, 0) = u1,,(x, 0) = 0 x>0 
u,(0, 1) = h(t) t>0 
This is just subproblem 2 of Problem 7.11; hence, 
0 O0<t<x/a 
u(x, = | 
h(t— x/a) O<x/a<t 
Subproblem 2 Uan(%, t) = A722 x(x, 1) + f(x, £) x>0, t>0 
u2(x, 0) = u2,(x, 0) = 0 x>0 
u2(0, 1) = 0 t>0 
or, extending f and u as odd functions of x, 
va(x, t) = a? vy. (4, t)+ Fe (x, 2) —wcx<m, ¢>0 
v(x, 0) = v(x, 0) = 0 oc y co 


The solution for v may be obtained at once from Duhamel’s principle (Problem 4.22) and the 
D’Alembert solution of the wave equation (Problem 7.10) for initial data prescribed at t= 7. Thus, 


ra 1 xt+atUi-7r) 

ieHe { [| Pies) az| de (1) 
0 2a x-a(t—7) 

Finally, restricting v to x > 0, we obtain from (/), for 0<t=-x/a, 


x+ati-7r) 


U(x, 1) = = [ ar | f(z, 7) dz (O<t<x/a) 


—a(i~7r) 


For 0< x/a <4, the triangle of integration in (7) must be decomposed into two regions, as indicated in 
Fig. 7-2. We find: 
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Hew = =: i de | i [2 aan ian faa dz| 


xtati-r) 
dr | f(z, 7) dz 


+ oe 
2a t-(x/a) x-al(i-T} 
1 t-(x/a) alt—T)+x lf xtali-r) 
=— ar | f(z, 7) dz +— | dt | f(z, 7) dz 
2a Jo a(t—r)-x 2a t-(x/a) x-ali-r) 
(O< x/a <2) 
T 


Lt 


z=x-a(t-7T) z=xta(t-7) 


Fig. 7-2 


7.13 Solve the following Dirichlet problem for Laplace’s equation: 
he eines, =0 r<l, -7<0<a7 
fer ee : 
u(i, 6) = f(@) -a7<0<7 
u(r, — 7) = uly, 77), ult, —77) = u(y, 77) r<il 
If we suppose that u(r, 8) = R(r)@(@), then, in the usual manner, we find: 


r(rR’y 6" | 
R 6. 


A 


subject to @(— zr) = O(7) and O'(—7) = O'(7r). Thus the separated problems are 
—0"=A0 -wK6<n7 
O(-7) = O(7), O(-7) = O77) 


and 
rPR"+rR'-AR=0 r<l 


R(O) finite 


As found in Section 6.4, the eigenvalues of the @-problem are A, =n? (n=0,1,2,...), with cor- 
responding eigenfunctions 


©,(6) = e’” and @_,(6) = e'"" (n=1,2,...) 
and @o(@) = 1. Now the r-problem may be solved to give 
R,(r)=r" (2 =0, 1,2,...) 
The superposition for u(r, @) is therefore 


oC 


u(r, A) = cot D, (Car e'? + car” em) 


= s cari! ein’ (1) 
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The boundary condition u(1, 6) = f(@) now determines the c, as the coefficients in the complex Fourier 
series for f(@) over (—7, 7): 


1 ¢* : 
m=s-| flpe™de (n= 0,41...) (2) 
27 Jing 
[cf. (6.15c)]. Substitution of (2) in (7), and transposition of summation and integration, yields 


rere = [| Sh! cin-0)] f(g) de 


—qw Ln=~o 


But, by the formula for the sum of a geometric series, 


es oe iat 
~ Inj in(O—&) 
2 & 1-2rcos(@-)+7r 
1- r a f() 
4 u(r, 6) = In | ae (@-e)+r 


which is the Poisson integral formula in the unit circle of R?. 


7.14 Solve 


4 (% yt u,(%4yJ=0 —-e<x<m, y>0 
u(x, 0) = f(x) oO < xX <o0 


The use of the Founer transform tn x is indicated: 


2 


d 
—a*U(a,y)+—~>Ul(a,y)=0 y>0 

dy 

U(a, 0) = F(a) 
The solution of the transformed problem which remains bounded for large y is 

U(a, y) = F(a) e7'*” 

Inverting by means of Table 6-2, line 3, and Table 6-1, line 8, we find: 
a0 f(z) _y f° f*—2z) 


u(x, y) dz= dz (1) 


Joy + (x- zy To y+ 2" 
Note that the change of variable z = y tan 7 takes the second integral (7) into 


afd 


LOS al eotae n)dn = (y > 0) (2) 


Hence, for f(x) continuous, 


lim u(x, y) = f(x) (-~< x <0) 


y0+ 
7.15 Solve 
Uy (% y)+ Uy (X, y)=0 -wo<x<w, y>O0 
u,(x,0)= g(x)  -@< x <0 


Let w(x, y) = u,(x, y). Then w(x, y) satisfies 


Wee (X, ¥) + Wyy(x, y) = 0 “MIX SM, y>0 
w(x,0)= g(x) -~< x <0 


from which, by (7) of Problem 7.14, 
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1 2y 
red Meera remy yg (1) 


Now, u(x, y)= JS” w(x, 2) df+ C(x). A y-antiderivative of w is obtained by integrating on y under 
the integral sign in (7): 


if ee = f (pers: az| g(z) dz 
. =| 8 (y? + (x — z)’) g(z) dz 


As for C(x), it must be bounded and harmonic; hence, a constant. (If u is steady-state temperature, C is 
an arbitrary reference temperature.) 


7.16 Solve 
u,(% y)tu(%y)=0 x>0, y>O 

u(x, 0)= f(x) x>0 

u(0,y)= gly) y>O 
Neither variable is restricted to a bounded interval; so separation of variables is not indicated. 
Neither variable ranges over the whole real line; so the Fourier transform does not seem to apply. 
Finally, the Laplace transform does not apply, since the equation is second-order in either variable but 
there is only one initial condition for either variable. However, a reduction of the problem to two 

subproblems, 
u(x, y) = u(x, y) + ualx, y) 


permits application of the Fourier transform. 


Subproblem 1 Ue + Uryy = 0 x>0, y>0 
u(x, 0)= f(x) x>0 
u(0,y)=0 y>O 


As previously, we obtain u; as the restriction to the first quadrant of a function v that satisfies 
Dux(X, YF Vy (% y)=O -w<x<m, y>oO 
v(x, 0) = F,(x) ~w <i xX <0 
where F(x) denotes the odd extension of f(x). By (1) of Problem 7.14, 


(sy=% [© 
PRE Ge aw y+ (x — zp 


ae TREN: igiaahe f(z) ae | 


7 wy t+(x-—zy Jo y?+(x- zy 
lores aa 
z)dz 
ado Ly? t(x—zy y?t+(xt2zy Faye 
of z 
z)dz 
mw Jo (x? + y?t+ 2p axe | ) 
Subproblem 2 Ur.xx + U2,yy = 0 x>0, y>0 


u(x, 0) = 0 x>0 
w(0,y)=e(y) y>d 


This is just subproblem 1 with x and y interchanged and f replaced by g; hence uz is the restriction to 
the first quadrant of 


(x, y) a | g(z) dz 
w(x, d 
y i (x? y? zy 4y?z? 
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Give two examples of boundary value problems for linear PDEs where separation of variables 
fails. 


(a) Ux(X, Y) + by (%, yt uy y)= 0  O<x <1, O<y<1 
u(x, 0) = u(x, 1)=0 O<x<] 
u(0, y)= Fly), u(ly)=0 O<y<1 
If we suppose that u(x, y) = X(x) Y(y), then X"(x) ¥(y) + X'(4) Y'(y) + X(x) ¥"(y) = 0 and there is 


no way to separate this expression so as to have a function of x alone on one side of the equation anda 
function of y alone on the other side. 


(b) Uxx(%, y) + Wy(%, y) = 0 0O<x<1,0<y<x 
u(x, 0) = f(x) O<x<1 
u(1, y)=0 O0<y<]1 
u(x, x) =0 0<x<1 


If we suppose that u(x, y)= X(x)Y(y), then the equation separates into two ordinary differential 
equations. However, the boundary conditions do not lead to a problem of Sturm—Liouville type either 
for X(x) or Y(y). The difficulty lies in the fact that the region {0 < x <1,0< y< x}is not a coordinate 
cell. This problem may, in fact, be solved by means of a clever transformation (see Problem 7.18). In 
general, when 2*€ is not a coordinate ceil, no such transformation is possible. 


Transform Problem 7.17(b) so that it becomes separable, and carry out the solution. For 
convergence of the series, assume that f(0) = f(1) = 0. 


Extend the problem to the square 0<x <1,0<y<1, making the boundary data antisymmetric 
with respect to the diagonal y = x (see Fig. 7-3). This forces v(x, x) = 0. Now, decompose the v-problem 
into two subproblems such that v = v4 v2. 


v= f(x) 
Fig. 7-3 
Subproblem 1 Vixx(% Y)+ Viyy(% y) = 0 O<x¥<1,0<y<1 


v1(x, 0) = f(x), vilx, 1) = 0 0<x<]1 
v,(0, y) = (1, y) = 0 0<y<] 


Upon separation of variables, the three homogeneous boundary conditions give the eigenfunctions 
sin nax sinh na(1— y) (n = 1,2,...) 
The remaining boundary condition then determines the superposition coefficients c, through 


f= s (c, sinh nz) sin nix (0<x<1) 


n=l 
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1 

or cn, sinh na = f, = 2{ f(x) sin narx dx 
i) 

(the nth coefficient in the Fourier sine series for f). Therefore, 


a J 
v(x, g) = > —"_— sin nix sinh ni(1— y) (O0<x<1, 0<y<1) 
n=1sinh nar 


Subproblem 2 is just subproblem | with x and y interchanged and f replaced by —f. Consequently, 


v2(x, y= ~ 2 
n- sinh ar 


Jn 


sin nary sinh na(1— x) (O<x<1, 0O<y<1) 


We conclude that the solution to Problem 7.17(b) is 


o 


u(x, y)= >) 


n=1Sinh nar 
(O<x<1,0<y<x) 


[sin nx sinh nw(1- y)— sin nary sinh n7w(i— x)] 


Supplementary Problems 


THE HEAT EQUATION ON A FINITE INTERVAL 
Solve for u(x,t) (0<x<@1>0). Use eigenfunction expansions in Problems 7.19-7.22. 
7.19 w= Ku, u(x,0)= f(x), uO, = golt), ult = gil). 


7.20 uy 


ll 


KUx,, u(x, 0)= f(x), uO, 1)= golt), ux(G 1) = g1(2). 
fe A | uy = Ku, u(x, 0)= f(x), u.(0, 1)~ pu(O, 1) = go(t) with p>O0, u(6 = g£c(2). 
7.220 u=Kux+ but+cu, u(x,0)= f(x), u(0O,)= g(t), u(6 O= gilt). 


7.23 Solve Problem 7.19 by means of the Laplace transform in 4 


THE HEAT EQUATION ON A SEMI-INFINITE INTERVAL 
Solve for u(x,t) (x >0, 1 >0). 
7.74 w= KU, Uu(x,0)=0, u.(0, 1) = g(t). 
7.28 Ww=Kux, Uu(%,0)=0, u,(0, t)— pu(0, t)= g(t) with p>0. [Hint: Let v(x, t)= u.(x, 1)—- pu(x, t).] 


7.260 UW = Ku t+ bu.t cu, u(x,0)=0, u(0, 4) = f(0). 


THE WAVE EQUATION ON A FINITE INTERVAL 


Solve for u(x, 1) (0<x<¢,1>0). Use eigenfunction expansions or the D’Alembert formula in Problems 
7.27-7,.31, along with Duhamel’s principle where appropriate. In Problems 7.32-7.34, apply the Laplace 
transform. 
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7.27) tte = tx, ule, O)= f(x), w(x, 0)=e(x), «.(0,)=u.(6)=0. 
7.28 un=a?uea, u(x,0)= f(x) w(x, 0)= 2x), ux(0, = u(€ t)=0. 
1.29 ug = Ate + f(x), u(x, 0)= (x 0)=0, uO, 1)= «(6 =0. 

7.300 Un = Gu —2cu, u(x,0)=0, ule O0)=2(x), 40, )= u(G)=0. 
731 Up = OU —2cu,+ B(x), U(x, 0) = u{x,0)=0, (0, 4) = u(G 2) =0. 
7.32 =u», u(x 0=u(x,0)=0, uO. N=fid, u(@t)= g(t). 
7.33 Un =a?ux, u(x,0)= u(x,0)=0, 40, = f(t), ul& = 8). 
=u, u(x,0)=u(x,0)=0, uO, N=f(), ul(6 1) = g(t). 


x 
2 
| 


734 


= 
g 
| 


THE WAVE EQUATION ON A SEMI-INFINITE INTERVAL 
Solve for u(x,t) («>0, t>0). 
735 Ug= QU, u(4,0)=u(x,0)=0, u,(0, 9 = f(t). 
7360 n= a*u,, u(x, 0)= u(x,0)=0, u,(0, t)- pu(O, 4) = f(t) with p > 0. 


LAPLACE’S EQUATION ON BOUNDED DOMAINS 
1.37 U(X, Y) + Uy(y y)=O0 OS x<1, O<y<l 
4.0, y)= f(y), uw, y)=8ly) O<y<] 
u,(x,0)= p(x), we l=qx)  O<x<l 
7,38 Vu(r, 0)=0 Osrsl, -7<O0<7 
u,(1, 6) = f(@) —17<0<7 
where J”, f(@) dé = 0. 
7.39 Vu(r, 0) =0 a<r<b0<6<_7 
u(y, 0)= u(y, 7) =0 a<r<b 
u(a, 0)=0, u(b, @)=1 O0<O0<m7 


LAPLACE’S EQUATION ON UNBOUNDED DOMAINS 


7.40 Ux(X, y) t+ Uy(y y)=O0 x>0, y>0 
u(0,y)=fly) y>O0 
u(x, O)= g(x) xx > 0 


7A Uxx(X, Y) + Uy (x, y) = 0 -wm<cxcw, O<y<l 
u,(x, 0) = f(x), wis = gtx) -@<x<@ 
7.42 Veu(r, 0) =0 r>l, -7<0<_7 
u(l, 0)=f(@)  -7<O0<_"7 
lu(r, 8)| <M r>1, -7w<0<7 


[Hint: Use the results of Problems 7.13 and 3.29(a).] 
7.43 Vulr, 6)=0 r>1, -7w<@<7 
u, (1, 6) = f(@) —7<O<a7 
|u(r, OL < M r>1,-7w<0<7 
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where J”, (0) d6 = 0. |Hint: Use the results of Problems 7.38 and 3.29(a), bearing in mind that the 


inversion will reverse the sign of the boundary derivative. | 


Chapter 8 


Green’s Functions 


8.1 INTRODUCTION 
In a region © with boundary S, let 
L{u] = f(x) in Q (8.1) 
Blu] =0 on S (8.2) 


represent, respectively, a linear, second-order PDE and linear boundary~initial conditions, such that 
for each continuous f, the problem (8.1)-(8.2) has a unique solution. Then G(x; &) is the Green’s 
function for the problem if this unique solution is given by 


ux) =| GOs€) fl) dO 


(We attach a subscript to the volume element to emphasize that the integration is with respect to the 
é-variables.) 


EXAMPLE 8.1 We know (Problems 4.2, 4.7, 4.17, 7.6) that the initial value problem for the heat equation, 


v, (x, £)— Vex(x, = 0 -aocy <0, 1 >0 
v(x, 0) = f(x) —M< xy <0 


has the unique solution 


« a pe 
ote = —— | exw [-S =| feo ae 
It then follows from Duhamel’s principle (Problem 4.23) that the problem 
ux, £)— U(X, 1) = f(x) -wcxy<ow, 1>0 (1) 
u(x, 0)=0 —wM< ¥<m@O (2) 
has the unique solution 
u(x, = i v(x, 1-7) dr i i... [-5 =a f(€) dé dr (3) 


From (3) we infer that the Green’s function for the problem (7 )-(2) 1s 


= [- (x 7) 
V4r(t— 7) 4(t— 7) 


G(x, 45 & 7) = (t>7>0) (4) 


It is seen that the Green’s function (4) exhibits singular behavior as x = (x, t) approaches & = (é, 7). This holds 
true for Green’s functions in general, and is reflected in the fact that G(x; &) for (8.1)-(8.2) satisfies, as a 
function of x, the PDE 


Lia] = 8(x~&) (5) 


which is (8&1) with f(x) replaced by the “function” &(x—&) (see Problem 8.1). We call a solution of (5) a 
singularity solution for L[ |. The essence, then, of the Green's function method is to represent f(x) in (8.1) as a 
“sum” of delta functions, thereby obtaining u(x) as the “sum” of the corresponding singularity solutions 
(adjusted to obey (8.2)). 
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8.2 LAPLACE’S EQUATION 


It follows from Problem 3.17 that the function 
1 
= |e forn=1 
sie 
1 
a(x;&) =; —log|x-&| forn=2 (8.3) 
207 
1 2-1 
— > |x 6 | forn2=3 
(2—n)A,(1) 
where x and € represent distinct points and A,(1) denotes the area of the unit sphere (see Example 


3.2), is the singularity solution for the Laplacian operator V7[_ ] in R”. 


EXAMPLE 8.2. For Laplace’s equation in three-space, ux + Uy + uz, = 0, with x = (x, y, z) and & = (, n, £), the 
singularity solution is 
1 


An[(x—éP + (y— ny + (z- Sy)? 


a(x, y,z387, g) 


Theorem 8.1; If & is a fixed point of R", then: 
(i) for n= 1, a(x; &) is dependent only on the distance r=|x — &|; 
(ii) for n=1, V2o =0 for all x ¥ &; 
(iii) for n> 1, the integral of the normal derivative of a over any sphere centered at 
x = & is equal to one. (This extends in the obvious way to R'.) 


Since o(x; &) = a(&; x), Theorem 8.1 is valid with the roles of x and & reversed. 
Because Poisson’s equation, V’u = p(x), is solved in unbounded R” by 


u(x)= [oc €)o(8) 4,0 


R 


the singularity solution serves as the Green’s function for V’[ ] when no boundaries are present; we 
call it the free-space Green’s function. We now show how to modify this function so that it gives the 
Green’s function when boundary conditions have to be satisfied. 

Let © be a region with boundary S, and take & to be a fixed point inside 0. If, as a function of x, 
V’h = 0 in Q, then the function 


b(x, E)= ol )th 


where h may depend on & as well as on x, is called a fundamental solution of Laplace’s equation in . 


EXAMPLE 8.3 Let 2 be the upper half of the xy-plane and Jet & = (g, 7) be a fixed point in 9. Both 
dilx, yg n= a(x, y; , n)+x7- y 
and fx, 36 n)= o(x% y5 & 0) t+ (x, ys & 0) 
are fundamental solutions of Laplace’s equation in 2. 
Theorem 8.2: Let © be a bounded region to which the divergence theorem applies. If @(x; &) is a 
fundamental solution of Laplace’s equation in 2 and if V7u = f(x) in O, then 


ue)= | #6; Bf) 40+ j (ut - 9 as (8.4) 
2 


where —=n-V 
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If f and wu are sufficiently well-behaved at infinity, then Theorem 8.2 is valid in unbounded regions. In 
(8.4) the roles of x and & can be interchanged to obtain an expression for u(x) (x in 2). 
Suppose that for each continuous f and g, the mixed problem 


Vu = f(x) inQ 
0 

aut B— = g(x) on S$ 
on 


has a unique solution. The Green's function, G(x; &), for this problem is the fundamental solution of 
Laplace’s equation in 2 that satisfies 
8G 


OT Bl on S$ 
n 


This homogeneous boundary condition ensures that, for @ = G, the boundary integral in (84) 
depends only on the known functions G, a, 8, and g, and not on u. (It does not, however, ensure that 
the boundary integral will vanish; that can be enforced only when the boundary condition on w is 
homogeneous, as in (8.2).) 

The remainder of this section assumes 8 = 0; i.e., it treats the Dirichlet problem 


Vu = f(x) in (8.5) 
u=g(x) ons (8.6) 
Theorem 8.3: The Green’s function for (8.5)—(8.6) is unique and is given by 
G(x; &) = a(x; &) + h(x; &) 
where, for each fixed & in C, A satisfies 
Vih=0 in? 
h=-o on S$ 
Theorem 8.4: For each fixed & in 0, the Green’s function for (8.5)-(8.6) satisfies 
ViG(x;€)= d(x-&) ind 
G=0 on S$ 
where 5(x — &) is the n-dimensional! Dirac delta function. 


Theorem 8.5: The Green’s function for (8.5)-(86) is symmetric, G(x; &)= G(&;x), and it is 
negative for all distinct x and & in . 


Theorem 8.6: \f (2 is bounded, the Green’s function for (8.5)-(8.6) has the eigenfunction expansion 


Gis 5 LOM 


=! r 
where V°u,(x) = A,u,(x) in Q, u(x) =0 on S, u, #0. 
Theorem 8.7: The solution of (8.5)-(S.6) is 


dG 
ux= | Go 8G) d+ { g&) Os as 
2 Ss 


aG 
where — (x; £)=n-V, G(x; &) 
on 


The techniques for constructing Green’s functions for Laplace’s equation include the method of 
images (see Problem 8.5), eigenfunction expansions, and integral transforms. In two dimensions, 
conformal mappings of the complex plane provide a powerful means of constructing Green’s 
functions for Laplace’s equation. 
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Theorem 8.8: (i) Let w = F(z) be an analytic function which maps the region © in the z-plane onto 
the upper half of the w-plane, with F’(z) #0 in Q. Then, if z=x+iy and f=&+m 
are any two points in £2, the Green’s function for (8.5)-(8.6) in R’ is given by 

: dl F(z)- F 
G(x, y; & 7) =— log i ae 
2a F(z)- F(® 
where the overbar denotes the complex conjugate. (ii) Let w = f(z) be an analytic 
function which maps the region Q in the z-plane onto the unit circle in the w-plane, 
with f(£) =0 and f’(z) #0 in Q. Then the Green’s function for (8.5)-(8.6) in R? is 
given by 


1 
G(x y,&n)= 3, 08 lf(z)| 


8.3 ELLIPTIC BOUNDARY VALUE PROBLEMS 


Given a second-order, linear, partial differential operator, L[ J], defined by 


en ou ", Ou 
Llu|= 3) a, +>) b,—-+ cu (8.7) 
ja. OX,OX; jay OX; 
the adjoint operator, L*| |, is defined by 
is a " 9 
L*|v] = 2 (av) » (bv) + cv (8.8) 
i j= OX;OX; int OX; 


It is assumed that the a, are in C? and the b, are in C'. For any pair of C? functions w and », 
Lagrange’ s identity, 


"are ou a) “| a; ; 
vL[u] - uL*[v] = > am [> a, (v a u ~) + uv (2, - all (8.9) 


i=l j=l j j ja O% 
holds. If M, denotes the expression in square brackets on the right side of (8.9) and M= 


(M,, M,,...,M,), then Lagrange’s identity takes the form 


vL[u]-uL*[v]=V°M (8.10) 
If (8.10) is integrated over a region © with boundary S, then the divergence theorem shows that 
| vL|u] ao= | uL*[v] an | M-ndS (8.11) 
9) 2 Ss 


where, as ever, n is a unit outward normal to S. 
Consider the linear boundary value problem 


L{uj=f inQ (8.12) 
Blu] =0 on S (8.13) 
where L[ | is an elliptic operator of the form (8.7) and 
ou 
Blu| = au+ B— 
on 
The adjoint boundary conditions, B*|v]=0 on S, are a minimal set of homogeneous conditions on v 


such that B[u] = B*{v] =0 on S implies M-n=0 on S. The PDE (8.12) is called self-adjoint if 
L*[ ]=L[ |; problem (8.12)-(8.13) is self-adjoint if L*[ ]=L[ ] and B*[ ]=B[ |. 


104 GREEN’S FUNCTIONS [CHAP. 8 


Theorem 8.9: Let x=(x,,x,...,x,) and €=(&,&,..., €). If (8.12)-(8.13) has a Green’s func- 
tion, G(x; €), then, as a function of the x-variables, G satisfies 


LIG]= 6(x- &) nQ (8.14) 
BIG] =0 ons (8.15) 
As a function of the &-variables, G satisfies 
Li[G] = 6(x- &) inQ (8.16) 
Bi{G]=0 on § (8.17) 


Theorem 8.10: 1£ G(x; &) is the Green’s function for (8.12)-(8.13), then G is symmetric in x and &— 
if and only if the problem is self-adjoint. 


Theorem 8.11: For (8.12)-(8.13) to have a Green’s function, it is necessary that u =0 be the only 
solution to L[u] = 0 in Q, Blu] =0 on S. 


8.4 DIFFUSION EQUATION 
For the diffusion equation in n space-variables, u,— « V’u = 0, the singularity solution is 
ly ss 7 =nnh =|k= £) 
K(x -&, t-—7)= H(t— 7) [4ar«(t- 7)|/™ exp | ———~ (8.18) 
Ax(t—7) 
Theorem 8.12: (i) As a function of x and 4, the singularity solution (8.18) satisfies 
K,-«ViK=0 (x, 0) # (E, 7) 
lim K(x- &, ¢— 7) = 6(x-&) 
fort 
(ii) As a function of & and 7, the singularity solution (8.18) satisfies 
-K,-«ViK=0  (& 74,9) 
lim K(x— &, t-— 7) = 8(x- €) 
Tat 
Theorem 8.12(i) shows that, as a function of x and 4, K satisfies 
K,-« V2K = &(x~ £)8(t- 7) (8.19) 
In the context of time-dependent heat flow, (8.19) permits the following interpretation: K is the 


temperature distribution in x at time ¢ due to the release of a unit heat pulse at position € at time 7. 
Theorem 8.12(ii) implies that, in & and 7, K satisfies ‘i 


—K,—«VEK = 8(x— £)8(t— 7) (8.20) 
Given a bounded region 2 to which the divergence theorem applies, a fundamental solution of 


the diffusion equation in 2, d(x, t; &, 7), is defined in much the same way as a fundamental solution 
of Laplace’s equation (Section 8.2). Specifically, we have: 


(x, 6&7) = K(x~- & ¢- 7) + I(x, t; &, 7) 
where J is any solution, in Q, of the dual problems 
J-« VF =0 {> -J,- «Vis =0 T<t 
J=0 t<7 J=0 7T>t 


EXAMPLE 8.4 Let © be the unit interval (0,1) of R’. Then, for O<x <1 and O0<&<1, one fundamental 
solution of the one-dimensional diffusion equation is 
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b(t, 5 & 1) = K(x- & t— 7) + H(t 7) e “6 cos (x ~ £) 
where K is given by (8.18) with n= 1. 
Another possibility would be 


dolx, Er) = K(x— 6 t-7)4+ S OK (x - &, 1-7) 


where the points &,, &,... are outside (0, 1) ancl where the constants C; are such that the series is convergent. 
Such a fundamental solution might arise when the method of umages is used to satisfy boundary conditions. 


Theorem 8.13: Let 1 be a bounded region to which the divergence theorem applies, and let u(x, f) 
solve 
u,- «Vu = f(x, t) xinQ, £>0 
u(x, 0) = u(x) xin 


Then, for any fundamental solution @ of the (homogeneous) diffusion equation, 
ue 0=[ | o65& NfG rd Odr+ | HG, 158 Due) 40 
o-2 a 
ou 
ve ff ( (o=-u 22) dySde (8.21) 
on 


If the integrands in (8.21 ) decay rapidly enough at infinity, Theorem 8.13 is valid for unbounded regions. 
Assume now that the problem 


u,— K Vu = f(x, t) xinQ, ¢>0 
u(x, 0) = u(x) xin 


ou 
aut B—= g(x,t) xon S, ¢>0 
on 
has a unique solution for any continuous f, uy, and g. The Green’s function, G(x, t;&, 7), for this 
problem is a fundamental solution of the diffusion equation which satisfies 
JG 
aGt B---=0 xon S, t>0 
on 


For @ = G, Theorem 8.13 yields u(x, ¢) as the sum of integrals of known functions (cf. Theorem 8.2 
and Laplace’s equation). Methods for constructing the Green’s function include images, eigen- 
function expansions, and integral transforms. - 


8.5 WAVE EQUATION 


The singularity solution for the wave equation in n space-dimensions, u, — a’V°u = 0, is 


1 
H(a(t— 7) — |x B55 (n= 1) 


i 
bg ed ET Ha)ysk= = 8.22 
k(x, t; & 7) (a(t—7)~ SD naa DPD EL (n =2) (8.22) 


1 
alld a aL errr CH= 3) 
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As with the diffusion equation, the singularity solution is a point-source solution in that & satisfies 
k,-@ Vk = &(x- &)8(t- 7) 
In the variables x, 4, the function k represents the causal Green’s function for the wave equation; in 


&, 7, it is the free-space Green's function. Figure 8-1 suggests the difference in interpretation, for 
n=l. 


(x, 1) 


(g. 7) 


(a) Causal Green's function (b) Free-space Green's function 


Fig. 8-1 


in contrast to the diffusion equation, however, the singularity solution for the wave equation 
depends essentially on the dimension n. For n = 3, the delta function in (8.22) implies that, at time ¢ 
the disturbance due to a local impulse at € = (€, n, ) at time 7 <4 is concentrated on the surface of a 
sphere of radius a(¢—7) with center at (¢ 7, £). However, for n=2, because of the Heaviside 
function, the analogous disturbance is distributed over the interior of a circle of radius a(t— 1) 
centered on the source. Both disturbances are traveling radially with speed @; but, while in three 
dimensions there is a sharp wave front that leaves no wake, in two dimensions a wake exists that 
decays like 1/a(t— 7) after the wave front passes. The foregoing observations form the basis of 
Auygens’ principle. 

Fundamental solutions of the wave equation and Green’s functions for initial-boundary value 
problems are obtained from the singularity solution as in the parabolic case, Section 8.4. In 
particular, consider the problem 


u, — a Vu = f(x, t) xin Qt, ¢>0 (8.23) 

u(x, 0)= u(x), u,(x, 0) = u,(x) xin Yd (8.24) 
Ou 

aut Bo = gtx, t) xon S, ¢>0 (8.25) 
n 


Theorem 8.14: If a (causal) Green’s function, G(x, t; , 7), for (8.23)-(8.25) exists, it is determined 
as the solution of either of the following problems: 


(i) G,-@VG= &x-&8(t-7r) x, Ein D 

G=0 t<r 

dG 

aG+B—=0 xons 

on 

(ii) G,-@VG=0  x,&inQ, t>7 
lim G=0, lm G, = 6(x-&) x, §inQ 
dG 
aG+B—=0 xon § 


on 
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Theorem 8.15: With G as in Theorem 8.14, the solution of (8.23)-(8.25) is, for a #0, 


8.1 


ues, )=| | G58 7)fE, 7) 40+ | [GO 156, 0) G.lx, 6 & Ou] 4,0 
0°29 2 


ee ; 1 8G 
“ | lee py tr fi & TEE, 7) dS dr 


where the normal derivative involves the &-gradient. If a =0, the last term is 
replaced by 


re 1 é 
+a J Fas Gx, & 7)g&, 7) dS dr 


and, for the pure initial-value problem (8.23)-(8.24), the last term is dropped. 


Solved Problems 


Let 2 be an open region and let T denote the set of all infinitely differentiable (C%) functions 
on 2 having the property that each @ in T is identically zero outside some closed bounded 
subset of (1. T is called the set of test functions on © (cf. Problem 5.15). A sequence {6,} of test 
functions is said to converge to zero in T if all the @, are zero outside some common bounded set 
and if {@,} and all its derived sequences converge uniformly to zero as n> %. Any rule d which 
assigns to each test function 6 a real number, (d, @), which satisfies the linearity condition (note 
that T is a vector space over the reals) 


(d, a6, + BO,) = a(d, 6,) + Bid, 4,) (a, B in R; 6,, 4, in T) (1) 
and the continuity condition 
lim (d, @,)=0 whenever {6,} converges to zero in T (2) 


is called a distribution or generalized function. (a) If f(x) is a continuous function in ©, show 
that the rule 


(f= | fx) (x) dO (3) 
2 


defines a distribution. (b) If x, is any point in ©, show that the rule 
(5, 0) = O(x,) (4) 
defines a distribution. 


(a) Since f is continuous and @ is C” and vanishes outside a bounded subset of &2, the integral on the 
right of (3) exists (i.e., is a real number). The linearity condition (7) follows immediately from the 
linearity in @ of the integral (3). To establish the continuity condition (2), let {6,} converge to zero 
in T. Since the 6, all vanish outside some common set, Q, in © and {6,} converges uniformly to 
zero on Q, 


lim (f, 0.) = im | FO, d00= tim | fon.aa=| dim 6,)fdOQ=0 
noo noo +} Q Q nw 


noo 


Thus, (3) defines a distribution. Because this distribution is determined exclusively by the 
continuous function f, it too has been given the symbol f. 
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(b) Since xo is in OD and 6 is a test function on N, the right side of (4) is well defined. The rule & assigns 
to the linear combination of test functions a6, + B62 the number 


@01(X0) + BO2(Xo) = a (8, 61) + B (6, 82) 


so (4) satisfies (1). For any sequence {6,} which converges to zero in T, it is clear that 
(6, 0,) = 6,(X0) 20 as n>; therefore, (2) is also satisfied. 

The distribution or generalized function (4) is known as the Dirac delta distribution or, more 
commonly, as the Dirac delta function. By a formal analogy with (3), it is common practice to write 


(6,0)= | 8(x~ x0) (x) dO = 0%) (5) 
2 
even though there is no continuous function f(x) that can be identified with 8(x — xo). 
A linear combination of two distributions, d, and do, is defined by 
(ad, + Bdz, 6) =a (di, 0)+ B (do, 6) (a, B in R) 


Products and quotients of distributions are not well-defined in general. However, if x = (x, y) and 
&=(& ), the two-dimensional 8-function 6(x—&) can be represented as a direct product of two 
one-dimensional 6-functions: 


8(x~ §£) = 6(x- £)8(y — 0) 


A distribution d is said to be zero on an open set ' in Q if (d, 0)=0 for every 6 in T which is 
identically zero outside 0’. In this sense, 5(x — xo) is zero on any region that does not contain xo. 


Establish Theorem 8.2 for R?. 


Let & = (& 7) be any point in the two-dimensional region © and let r= |x— &] be the distance from & 
to any other point x = (x, y) in Q. Let s be a circle of radius € centered at &, and let 0’ be the portion of 
Q. exterior to s. From Green’s second identity, (1.8), 


J wvro—dveuacr=f (v2 9%) as + | (ut 5) ds (1) 


on x on 


In both boundary integrals of (1) the contour is described so that 9’ is kept to the left (see Fig. 8-2). 


Fig. 8-2 


Since ¢ is a fundamental solution with singularity at & which is not in 1’, 
V*6 =0=VWu-f in YY (2) 


On s the outward normal derivative of @ relative to 1’ is 
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8.3 


a a 


on or 


ree 27é€ or 


wherefore (consult Fig. 8-2; ds > 0) 
ab du om py oh du 

| ( —- ,) ds =| ( u +h ) ede 
on o \27¢€ or or 


-t ew) doe [" (wo) do (3) 


2a or 


Now, the first term on the right in (3) is just the mean value of —u over s; so, it approaches —u(E) as 
e—>0. As for the second term, since 


1 
ree =~ loge t+hl--- 

$|--<= 5— log | 

it vanishes as € log €, as « >0. Consequently, if we let e >0 in (17), we obtain 
Ob ou 

-{ ofan=[ (u*- 6“) as— we) 
2 Ss on on 
which rearranges to (8&4). 


An alternate (but purely formal) derivation of (8.4) can be given using the Dirac delta function. The 
fundamental solution ¢@ satisfies 


Vb = &(x- &) inQ (4) 


Substitute (4) into Green’s identity 


[ ave Vu) dQ = [.( (ut ° =) as 


and use the sifting property of the 6-function, (5) of Problem 8.1, to obtain (84). 


Assume that a Green’s function, G(x; &), exists for the mixed boundary value problem 


Vue=f(x) ind (1) 


fe) 
autB—=0  onS (2) 
on 


with a ~ 0. Formally show that (@) G(x; &) as a function of x satisfies 


VG=6(x-&) in (3) 
0G 

aGt+B—=0 ons (4) 
on 


(b) G(x; &) is symmetric, G(x; &)= G(&; x); (c) the solution to (1) subject to the non- 
homogeneous boundary condition 


Ou 
au+ B= g(x) on $ (5) 
on 
is given by 
wis) = | Gow e)70) d+ | a a6) 8) ays 
a 


a(€) 
where 0/On=n> V;- 
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If G(x; &) is the Green’s function for (7 )—(2), then by definition 


ae i; G(x; &)f(&) dO 


From fx) =Viu= [ V2 G(x; E)f(E) dO 
2 
it follows that V2?G(x; &) has the sifting property of the Dirac delta function, and so (3) holds. From 
ou 8G 
o=aure“=| faG+p—] fe) dQ (con) 
on a on 


and the arbitrariness of f, (4) follows. 


In Green’s second identity, 
adding and subtracting 


on the right gives 


1 gu dv Ov\ du 
i (u Vv — vV2u) dQ = = |(au+ p=)? (a4 >) =| as (6) 
2 sa Oon/ an on/ On 
If u and v both satisfy (2), by (6), 
[ uv da = | vV*u do. (7) 
a a 


Now, if x; and x2 are distinct points in Q, u = G(x; x;) and v = G(x; x2) both satisfy (2), by part (a); 
furthermore, Vu and V’v both have the sifting property. Thus, (7) gives: 


i G(x; x1) 8(x — x2) d= i G(x; x2) d(x — x1) dO. 


or G(x; x1) = G(x1; X2). 
In (6) let v = G(x; &) and let u be the solution of (7) and (5). Then, since v obeys (3)-(4), (6) yields 


we) = [Go 8/09 40+ | 9) (6) des (8) 
ro ‘ s a(x) on Money 


Interchanging the roles of x and & in (8) and using G(x; &) = G(&; x) Jeads to the desired formula. 


8.4 If O is the rectangle O0< x <a,0<y<b, find the Green’s function for the boundary value 
problem, 


Vu= f in (1) 
u=g on $ (2) 
The required Green’s function is symmetric, G(x, y: & n) = G(&, 7; x, y), and is defined by 
Gur + Gy = O(x- £)8(y-— 9) (x yin ® (35 
Giuy;&7)=0 (xy)ons (4) 
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Method 1 (Eigenfunction Expansion) 
The eigenfunctions for the Laplacian V* on © subject to zero Dirichlet boundary conditions are the 
nonzero solutions of 


Wu=aAu in u=0 onS (5) 


Using separation of variables to solve (5) gives the eigenvalues, A,»n, and corresponding normalized 
eigenfunctions, Unn, aS 


The expansion 
Guys &M)= dD Can 7)Umals ¥) 
mont 


satisfies the boundary condition (4). Since V7tUnn = AmnUmn, it will satisfy (3) if 


DX CaaS 1) Amn tina(X, y) = 8(x — €)8(y — 1) (6) 


mn=l 


To find the C,,, multiply (6) by u(x, y) and integrate over 9, using the orthonormality of the 
eigenfunctions (the weight function is unity) and the shifting property of the delta function: 


3 Cals [ 


Unal% Yeats ¥) dx dy = | 3(E~ 6)3(y~ 1) ta y) dx dy 


mon=l 2 
CrgAvg = Upg (g, n) (7) 
Therefore, 
S. UmalX, Y) UmalE, 7) 
Gixyi&n= > 

mona Amn 
_ mmx — nay . ma& — ni 
sin sin sin -——— sin —— 

—4 a b a b 


= 8 
ab s ma\? naz? (8) 
Gore 
a b 
in agreement with Theorem 8.6, wherein r counts pairs (m, n). 


Method 2 (Partial Eigenfunction Expansion) 

In this method, G is expressed as an eigenfunction expansion in only one of the variables, say y. Let 
tt, and v,(y) be the eigenvalues and the normalized eigenfunctions of the eigenvalue problem for the 
y-part of the Laplacian, subject to zero Dirichlet boundary conditions; i.¢., v” = u,v, v(0) = 0= v(b). We 
have 


An expansion for G of the form 


Gy yi &n)= > An(x, & 7) dn(y) (9) 


satisfies the boundary conditions on the horizontal boundaries, y= 0 and y = b. Substitution in (3) gives 
>, (Ant tnAn)oay) = d(x — €)8(y — 7) (10) 
n=] 


where ' denotes differentiation on x. Multiply (20) by u(y), integrate both sides from y = 0 to y = b, and 
use orthonormality to obtain 
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n+ eA = 0x (7)8(x - €) 


To ensure that G=0O on x =0 and x=a, A, must vanish on x =O and x =a. This means that the 
function 


Ax (x, é, n) 
EQ = 
v% (7) 
must be the Green’s function for the ordinary two-point boundary value problem 
u"t+ pyu= f O<x<a 
u(0) = u(a)=0 
Now, from the theory of ordinary differential equations, we have 


Theorem 8.16: Suppose that when f= 0, u=0 is the only solution to the two-point boundary value 
problem 
a(x)u"(x) + b(x)u'(x) + c(x)u(x)=f() xa <x <n 
au(x1) + Biu'(x1) = 0 
@f2U(X2) + Bou'(x2) = 0 


in which a(x) # 0. Then the Green’s function for the problem is given by 


ui(x)u2(é) pee 
a(é)W(é) 

a(x; &)= EE) ade 
a(é) W() s 


where, for i = 1, 2, u; satisfies 
au + buit+cu=0 XxX <Q 
aly; (x;) + Byui(x:) = 0 
and where W(é) = u1(€) ua(€) ~— uo(€) ui(€) is the Wronskian of u; and «2 evaluated at € 
By Theorem 8.16, with u; = sinh (A7x/b) and u2= sinh (k(x — ay/b), 


k kn(€- 
sinh a sinh ee) 
b b 


r O<x< 
kr kaa v(n) an 


Au, & 9) = 
«@ &) _. kr€ .. ka(x-a) (2) 
sinh sinh 
b b 


<xK< 
kw |. ka v(n) oorae 


— sinh 
b b 


Although the series (9), with coefficients (1/1), is more complicated in appearance than (8), it is the more 
rapidly convergent, because 


|An(x, & 9) = O(e7 kh) 


as k>&, 


8.5 Use the method of images to find the Green’s function for 
Vu=f ind 
u=pg on $ 


if Mis (a) {-e2< x <~, y>O}, (b) {O<x<~, y> 0}, (c) {-e<x<m,0<y< 5d}. 
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When applying the method of images to Laplace’s equation in R?, it is often helpful to interpret the 
free-space Green’s function, a(x, y; & 7), as the steady xy-temperature distribution due to a unit line 
sink at (é, 7). (“Sink,” not “source,”’ because of Fourier’s law and Theorem 8.1(iii).) 

(a) In -~<x<~, y>0, if o(x%, y; & 7) represents a sink at (7), n > 0, then a symmetrically placed 
source at (£,—7), ~o(x, y; €& —7), will ensure a zero temperature on y = 0. Because h(x, y; & n)= 
—oa(x, y; &—7) is harmonic in y > 0, we have from Theorem 8.3: 


2a ty P= ny 
(x ~ €P + (y+ nf 


(b) Placing sinks, +0, and sources, —o, as indicated in Fig. 8-3(a) shows the Green’s function for the 
first quadrant to be 


1 
Gy yEn)=o(4y,6n0)-o(y ys &-n)= rae lo 


Gly ys & m= a(% vy & n)— oly y; -§ 9) t+ o(% y3 -& —n)- o(4 5 & -0) 
autelaes [eo ow too) 
da (x+ EP t+ (y- ny @- EP tit ny 


(b) 


Fig. 8-3 


(c) In this case, an infinite series of sources and sinks is required to make G=0 on both y = 0 and 
y= b, For0<7 <b, Fig. 8-3(5) shows that sinks must be placed at n, 7 +26, 7 = 4b,... and sources 
at —y, -n +2b,-—n +4b,.... Thus, 


G(x, ys&n)= > [oly y: & 2kb+ n)- ox, ys & 2kb- n)] 


k= 


8.6 Find the steady xy-temperature distribution in the half-plane y >0 due to a line source of 
strength 2 at (x, y) = (1,3) and unit line sinks at (—5, 6) and (4, 7). The boundary, y = 0, is held 
at temperature zero. 
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The Green’s function, G(x, y;& 7), which was constructed in Problem 8.5(a), gives the xy- 
temperature distribution due to a unit sink at (€ 7) and zero temperature on y =0. Therefore, the 
solution to the present problem is 


u(x, y) = —2 G(x, y; 1,3) + Gy y; -5, 6) + G(x y; 4,7) 


Use the method of images to find the Green’s function for the n-dimensional Dirichlet 
problem (n = 2) 
Vu = f(x) Ix|< R 
u= g(x) = |xj= R 
Let x and & be two points inside the hypersphere of radius R; their inverse points (Problem 3.29), 


outside the hypersphere, are 


R? R? 
x! x g=—-€ 
lg? 


ik? 
Let us find the relation between the distances r = |x — &| and r’ =|x’— &'|. 
1? = (x! — 6) +(x’ — &) = (x= x’) + (EE) - 2(x'- &’) 


R* R* > R* (x-&) 
x" 
Ix? |&? |x? 1g? 


(ep eae 

= -E)+ (x-x x 6)=——, 

PIE ix EP 
id R? 
or r= r 
rT 


From this it follows that if € (and with it, &’) is held fixed while x (and with it, x’) is allowed to approach 
the boundary point s, 


(1) 
independent of the location of s on the hypersphere. 
Now, by Theorems 8.1(i) and 8.3, the desired Green’s function must be of the form 
G(x, €) = o(r) + h(x; €) 


where a is the free-space Green’s function, and hk is harmonic inside the hypersphere and just cancels o 
on the boundary. On account of (1), we see that both conditions for h are satisfied by the function 


R 
x(n) --e(e-e)) 
R Rf 
(If f(x) is harmonic, so is f(cx), for any constant c. It can now be recognized that the geometrical 
property of the sphere expressed in (7) is crucial to the method of images.) 


For the linear differential operator 
Llu] = u,,+ u,, + 2u,—u, tu inQ 


find (a) the adjoint operator; (6) the adjoint boundary conditions corresponding to 
; 5 Ou 
(i) u=0 (ii) u+—=0 
On 


on S. 
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(a) From (8.8), L"[v] = vse + Vy — 20, + vy + v, and M, and M2 in Lagrange’s identity, (8.9), are 
My, = vu, — uv, + 2uv M2 = vu, — Uvy — Uv 


Consequently, 


ou dv 
i (Muni + Manz) ds = | [eau + Om nau dS (1) 
s s on on 


(b) (i) To make the integral (7) vanish for all u such that B[u]=u=0_ on S, we must require that 
B*lo]=v=0 ons. 


(ii) For any u satisfying Blu] = u+(du/dn)=0 on S, the integrand in (1) equals 


u | Cn n2—1)v oa 4 Be) 


which defines the adjoint boundary condition, B*[v]=0 on S. 


If © is the rectangle O<x<a, 0O<y<b, find the Green’s function for the boundary value 
problem 


We tty Di = f(X; Y) inQ (1) 
u = g(x, y) onS (2) 
(Compare Problem 8.4.) 
The Green’s function, G = G(x, y; &, 7), is defined by 
Gyx + Gy + 2G, = 5(x — E)8(y — ) in (3) 
G=0 on $ (4) 
An eigenfunction expansion is most simply obtained if the left side of (3) is put in self-adjoint 
form. From Problem 2.14 we see that the change of dependent variable H = e*G eliminates the 
first-order x-derivative, giving 
LIH) =. + Hy — H = e*8(x - £)8(y - 0) in 2 (5) 
H=0 on $ (6) 
We now proceed to look for an expansion of H in terms of the eigenfunctions of problem (5)—-(6); that 
is, we set 


H= > CanWmn (7) 
mn=l 


where L[Wmal=AmaWma in Q and Wa, =O on S. Using separation of variables, we find for the 
eigenvalues and normalized eigenfunctions 


ma\? nay? 2 . mm | niqwy 
Amn =~ ( ) ( ) wae sin sin 
a b V ab a b 
Substituting (7) into (5) gives 
DS) CmnAmaWmn = €*5(x — €)6(y — 7) (8) 


mana 


If (8) is multiplied by w,, and integrated over 0, then the orthonormality of the eigenfunctions implies 
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Therefore, 


5 . sin sin b sin sin js 
a a 
G(x y3&n)=-—e* > 5 5 
oH) 
a b 
8.10 (a) Show that the Neumann problem 
Vu=f inQ (1) 
Ou 
—=g onS (2) 
on 


does not have a Green’s function. (6) Define a modified Green’s function that will give the 
solution of (7 )~(2) up to an additive constant. 


(a) Recall (Example 3.8) that a necessary condition for the existence of a solution of (1)-(2) is 


(b) 


| fan= | eas (3) 


Assume that (3) holds, so that (7 )-(2) has a solution which is unique up to an additive constant. By 
analogy with the case of a Dirichlet boundary condition, the Green’s function for (1)-(2) must 
satisfy 


VG = &(x-&) inQ (4) 
3G 
—-=0 ons (5) 
on 


But (4)-(S) has no solution, since (3) does not hold for it. 


Let a modified Green’s function, or Neumann function, N(x; &), for (1)-(2) be defined, up to an 
additive constant, by 


VN = 5-8) inQ (6) 
aN on.S (7) 
on 


where VQ) is the volume of ©. Now condition (3) is met. Apply Green’s second identity to 
solutions of (7)-(2) and (6)-(7): 
ou 


aN 
) ds 
n on 


[. (uWN -N Wu) dQ= I, (uN 


RC [s-8- Fa) an=| (0-Ng)as 


ue) a-] Now: 8)fe) aa=- | N(x 8) 80) as 
n Ss 
or, interchanging x and &, 


u0x)= | NOx: 870) ded | NOB) a(&) deS+ (8) 
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8.12 


In view of (3), the right side of (8) has the same value for ail solutions N of (6)-(7). Hence, (8) 
determines u(x) up to the additive constant & the mean value of u over 2. 


Show that the singularity solution for u,— Ku,, = 0, 


K(x-& t-7T)= (t> 7) 


1 7 [ee 
V 4a (t— 7) 4«(t— 7) 


satisfies [™, K(x — &é,t- 7) dx = 1 for all ¢> 7. 


Let us exploit the fact that if f(x) and F(a) are Fourier transform pairs (Section 6.4), 
| f(x) dx = 27 F (0) 


Now, from Table 6-2, line 1, and Table 6-1, lines 7 and 3, 


1 1 ; 
f(x) = EP 7) and F(a) eige S enka eb 
V 4aK(t— 7) 2a 


are Fourier transform pairs, and we see that 27 F(0) = 1. 


If f is a bounded continuous function, show that 


lim | K(x —  ¢~ 0)f(€) dé = f(x) (1) 


190+ 7 Lo 
Since K is symmetric in x and & Problem 8.11 implies 
[ Ke-s0d=1  @>0) 
From 


[ Ke-gof@ae-| Ko-g fae] Kes 01M - fl ae 


=fe+] Kos 01f@)- fla) dé 


we see the last integral must be shown to approach zero as t> 0+. Let s =(x— €)/V 46; then, using the 
explicit expression for K, 


an ic K(x- & OLE) — f(x)] dé = J = ie eo [ f(x + sV 40) — f(x)] ds 
2 e~* lim [f(x + sV‘40) — f(x)] ds = 0 
v TT ~ oo 170+ 


The boundedness of f ensures that the improper integral in s is uniformly convergent, which allows the 
limit to be taken under the integral. Then the continuity of f implies that 


[fx + sV'40) — f(x)]>0 


as t> 0+. 
A similar, but more complicated argument establishes (72) if f is continuous and 


[f(x)| << Ae?” 


for constants A and B. Equation (1) shows that as ¢ approaches 7 from above, the singularity solution 
K(x — &,t— 17) approaches the delta function (x — €). 
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8.13 If Q is the first quadrant (x > 0, y > 0), (a) find the Green’s function for 


u,— K(u,, + u,,) = f(x y, inQ, 1>0 (1) 
u(x, y, 0) = u(x, y) in Q (2) 
u(x, 0, I) = u(x, t) x>0, 1>0 (3) 
4,0, y,)= uly, t)  y>d, 1>0 (4) 


and (b) use (8.21) to express the solution of (1)-(4) in terms of G and the data f, up, u,, Up. 


(a) The Green’s function is a fundamental solution, G = K + J, with J chosen to make G=0o0n y=0 
and G,=0o0n x =0. The singular part, K(x, y, t; 7,7), of G represents a point source (e.g., a 
burst of heat) at (€, 7) in 0 at time 7. To make G zero on y=0a sink, —K(x, y, t; & —n, 7), at the 
image point (€,—7) is required. In an attempt to zero G, on x =0, place a source at (—é, 7). 
Finally, balance these two images with a sink, —K(x, y, t; —& —7, 7): 


G(x y thE = K(4y,66n, 7)- K(yu yt —-7,7)+ Ky yt) -§ 0, 7)- K(x y, & —& — 0, 7) 


(6) wosxd=| [| Goox0: 80 ME 12) dé dn dr 
0 “0 0 
+{ { G(x y, t; & n, 0) uolé, 0) dé dn 
0 re) 
+e] | ua(n, T) G(x, y, t,0, 0, 7) dn dr 
0 0 


+ | ui(E, 7) Go(% yt; &.0, 7) dé dr 
0 70 


where the boundary integration is in the positive sense; i.e., first in the direction of decreasing 7, then in 
the direction of increasing é. 


8.14 Find the Green’s function for the initial-boundary value problem 


u,— KU, = f(x, 8) O<x<& 1>0 
u(x,0)= g(x) O<x< 
u(0, )=h(), UE D=hl) 1>0 
Method 1 (Reflection) 


Proceeding as in Problem 8.5(c), place sources +K along the x-axis at £+2né, and sinks —K at 
—&+2n€, where n =0, +1, +2,.... This yields 


co 


G(x & r)= DI [K(x— €-2n€1— 7)- K(x + €-2n€t~-7)] 


no 
for t>7; fort<7, G=0. 


Method 2 (Partial Eigenfunction Expansion) 
The Green’s function may also be characterized as the solution of 


G,— KGux = 8(x — E)5(t— 7) (1) 

G=0 x=Oandx=@¢ (2) 

G=0 <7 (3) 

The space part, d*/dx”, of the linear differential operator has eigenvalues A, = —(nz/€Y and corresponding 


normalized eigenfunctions 
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2. mmx 
vn (x) = [2 sin 2 


(cf. Problem 8.4). Thus, the expansion 


wo 
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G => Cnt, é, 7) a(x) 


as 
nel 


satisfies (2). Putting (4) into (7) gives, with a prime ’ denoting time differentiation, 


SD (ch = Anca) On (4) = 8(x — €)8(t-— 7) 


n=l 


which, multiplied by v(x) and integrated from x =0 to x = €& becomes 


Chim KAmCm = Um(E)6(t— 7) 


On account of (3), c, =0 for t<7. For > 7>0, integrate (5) from t=0 to t= ft, obtaining 


4 


Cm(t1) — KAm Cm(t) dt = um (E) 


= 


The solution of (6) is (verify by substitution): 


G(r) = Um (E)enamer—? 


Hence, 


t<T 
2 


0 
G(x, t: & 7) {2 » ag ("2) ‘etl | a na4x a name 


é 


n=l 


Solve the initial value problem 
U, — aU, = f(x, t) 
u(x, 0) a Ug(x) 
u,(x, 0) = u,(x) 


using a Green’s function. 


é 


—wa<c yw, ¢>0 
~—o<maxX< wo 
—-O<S y< wo 


By (8.22) with n= 1, the free-space Green’s function is 


1 
G(x, t) & 7) = H(a(t— 7) — |x - see 
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(4) 


(6) 


To use Theorem 8.15 to write the solufion, u(x, 4), we need G,(x, 1, 6,0). Now, the derivative of the 
Heaviside function is the 8-function (see Problem 8.19(5)), so that 


1 
G.(x, 5 £0) = —5 dlat— |x— £)) 


and 


Sea oc e ‘i 1 (me 1 iy x “i 
u(x, t)= lll f(& 7) dé adr on - uy(£) dé + 3 [uo(x ~ at) + u(x + as] 


—ati-r) 


which is the D’Alembert solution. 


Solve by a Green’s function: 


u, — Vu = f(x, 2) 
u(x, = 0, u,(x,0)=1 


xin R?, 1>0 
xinR® 
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The Green’s function is the free-space Green’s function for the three-dimensional wave equation 
(with a = 1), 


G(x, t, & r) = ey d(¢—7- |x - &[) 
and Theorem 8.15 gives the solution as 
u(x, )= ip | 2 5(t— 7 — |x — E)F(E, 7) AQ dr + [ eee b(t — |x - &|) dO 
o Jw 4a x ~§| n3 4c |x — &| 


When the order of integration is reversed, the double integral is seen to have the value 


1 
—— Fé, t~ |x - €]) dO ( 

Jesse An Ix _ g| A . ) 
When the origin of &-space is shifted to the point x and the polar coordinate r = | — x| is introduced, the 
other integral is seen to have the value 


“J 
[ ee Sy cree (2) 
fa 4ar 


(as would have been found immediately if the original problem had been split into two subproblems). 
The expression (7), the part of u that is independent of the initial conditions, may be interpreted as 

the superposition of disturbances which arose at points & at times previous to ¢ and, traveling at speed 1, 

are just reaching point x at time ¢ For this reason, the integrand in (1) is called the retarded potential. 


Supplementary Problems 


(a) If © is the set of real numbers and a > 0, show that 


1 
exp |—> x|<a 
O(x) = E cs a) a 
0 |x| =a 
is a test function on Q. (5) Show that 
exp (sca) xt ty? <q? 
A(x, y= x? + y*— a? 
0 rey? za 
is a test function on 0 = {(x, y): x?+ y?< R*, R>a>O}. 
Let 6,(x) be the test function obtained by replacing x and a in the function of Problem 8.17(a@) by x/n 
and a/n, where n = 1, 2,3,.... Show that {6,(x)} converges to zero in T. (See Problem 8.1.) 
If Q is the real line, define the distributional derivative, a', of a generalized function d@ by 
(d’, 6) = —(d, 8’) 


for every test function 6 on Q. (a) If f is a continuously differentiable function, show that the ordinary 
and distributional derivatives are equivalent in the sense that the distribution defined by the continuous 
function f’ [via (3) of Problem 8.1] is the distributional derivative of the distribution defined by f 
(6) Show that the rule 


(H, 6) = [ 6(x) dx 
x9 
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8.23 


8.24 


8.25 


8.26 


8.27 


8.28 


where Xo is a fixed real number, defines a distribution corresponding to the (discontinuous) Heaviside 
function A(x — xo); show further that H’ = 6, the distribution defined by (4) of Problem 8.1. (We usually 
express this result by saying that the derivative of the Heaviside function is the delta function.) 


With © the x-axis, let d be a generalized function, @(x) a test function on Q, and g(x) a C® function. 
Define 
(g(x) d, O(x)) = (d, B(x) A(x) 


Prove: (a) g(x) 5(x — y) = g(y) d(x — y) and (6) «8(x) = 0. 
Find the generalized derivatives of (a) |x|, (b) e*8(x), (c) x8(x). 


Derive the formal sine and cosine series for the delta function, 5(x — €), on the interval (0, @), with 
O<xE< 


Given a bounded region 22, let a Green’s function be defined by 


VG °G= &(x-&) inf? 


G=0 ons 
Expand this Green’s function in terms of the eigenfunctions u,, where V*u, = —AZu, in QO, u=O0on S, 
u, #0. 
Represent the Green’s function for 
Veu-cu=f(xy) —-e<x<~, 0<y<a 
u(x, 0) = u(x, a) =0 —o< xy <0 


by an eigenvalue expansion. 


Verify that the Green's function for the problem 


V7u = f(x, y, 2) z> 
u,~ cu=0 


oo 


where c =0, is 


1 1 
Guy 273670 


4n[(x—€P + (y— ah t(z- ey]? 4al(e— EP + (y—nP +t cy? 


C ~¢ ecto 
rh | 2 2 ain 4S 
2a) Hey ee ay te s)] 
Use the method of images to find G(x, y; & 7) for 
Vu=f O<xr<m, O<y<b 
if (a) u=0 for x =0, for y=0, and for y= b; (6) u=0 for y=0 and for y= 6, and u, = 0 for x = 0. 
[Hint: Make use of the Green’s function, Go(x, y; &, 7), of Problem 8.5(c).] 


Use a Green’s function to solve Problem 7.14. 


Use Theorem 8.8(ii) and the mapping 
R(z- 
w= ae) (R > 0) 
zl-R 
which carries |z| << _R onto |w|< 1, to derive the Green’s function for the problem 
Uz + Uyy = f x7 + y?< R? 
u=e8 x24 y?= R? 


Check your answer against Problem 8.7 (n = 2), identifying x and & with the complex vectors z and ¢. 
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Show that w = —e (6 >0) maps the infinite strip 0<x< b,-«2<y<o of the z-plane onto the 
upper half of the w-plane. Then use Theorem 8.8(i) to show that the Green’s function for Laplace’s 
equation which vanishes on x = 0 and x = 6 is given by 


[ut me 
sin ———— 
G(x, y; & 7) ae ae 
ma go 27 . _ a(zt+e) 
dL Cerra 


where z=x+ ly, {= &+ in. Finally, use the infinite product representation 


2 


sinz=2z [|] (1-5) 
nt 


to compare this result with the one obtained by the method of images (interchange x and y in Problem 
8.5(c)). 


Show that in two dimensions the biharmonic equation, V‘u=0, has the singularity solution 
r°(1— log r)/8. 


Find the adjoint of each of the following differential operators: 


(a) Llu] = ust Wy + ue — Uy + 3u (d) Lluj= unt wy + xu, + yuy 
(b) Liu] = ua — uy (e) Llu] = a+ uy, + yur + xu, 
(c) Llu] = bee — Un (f) Llu] = x7tx + y*Uyy 


If Llu] = aun. + 2buy + cuyy + du, + eu, + fu has constant coefficients, show that L is self-adjoint if and 
only if d=e =0. 


Show that the linear PDE au,, + 2bu,, + cu,, + du, + eu, + fu = g is self-adjoint if and only if it can be 
written in the form 
(au, + buy), + (bu, + cu,)y + fu = g 


Let L[ ] be the differential operator of Problem 8.33 and assume that the coefficient functions are in C?. 
Show that L is self-adjoint if and only if a, + by = d and 6,+c¢, =e. 


If the PDE of Problem 8.33 is not self-adjoint, under what conditions will a reducing factor, R(x, y), exist 
such that after multiplication of the equation by R a self-adjoint equation results? 


Find a reducing factor for ux. + 2uxy + 2u,, + ue + uy + 3u = 0. 


Given the boundary value problem 
Llu] = ux + uy, + 2u, + 3u, = f O<x<a,0<y<b 
u=0 onx=Qandx=a 
u, = 0 on y=Qand y=6 
(a) write the adjoint operator and the adjoint boundary conditions; (b) write a boundary value problem 
in x and y for the Green’s function. 
Solve 


Uxx + Uy + 6uy = 6(x-2)8(y) OS <1, —w<y<m 
u(0, y)= u(1, y)=0 omy <a 


[Hint: Let u = e7*’v, make a partial eigenfunction expansion of v, and use the Fourier transform to find 
the coefficient functions. | 
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8.39 Refer to Problem 8.7. Show that in &-space, the normal derivative of the Green’s function on |&| = R is 
given by 
dG R?—|xP o(r) 
on R r 


From this, infer Poisson’s integral formula, (3.5). 


8.40 Using the free-space Green’s function and the definition 
7a (eee 
erf ze —— | e* ds = 1~—erfc z 
Varo 


(cf. Problem 2.17 and Table 6-4, line 9), solve the initial value problem u,— Ku, =0 (-~<x<~,4>0), 
u(x, 0)= x/|x| (x #0). 

8.41 Using superposition arguments (and nothing else), infer from the solution of Problem 8.40 the solutions 
of the following problems: 


(a) U,— Ku, =0 x>0, 1>0 (d4) u-Ku,=0 -o<x<w, 1 >0 
u(x, 0)= U x>0 u(x, 0)= U Ix| << @ 
u(0, 1) =0 t>0 u(x, 0)=0 |x| > 
(b) & — Kix = 0 x>0, +>0 (e—) W- Kb, =0 -e<x¥<m, 1 >0 
u(x, 0)=0 x>0 u(x, 0) = 0 Ix} < @ 
u(0, )= U t>0 u(x, 0)= U |x| > ¢ 
(c) w-Ku, =0 -~<x<m, 1 >0 (f) uw— Ki, =0 0<x<a, 1 >0 
u(x, 0) = UH(x) x #0 u(x,0)=U b<x<e 


u(x, 0) = 0 O<x<borx>c 
u(0, t)=0 t>0 
8.42 Prove the product law: If v(x, t) satisfies v,-— Kv,.. =0 and w(y, £) satisfies w,— Kw, =0, then u = ow 
satisfies u,— K(Ux. + Wy) =0. 


8.43 Find the Green’s function and the solution for the following problems: 


(a) u— Kix =f(%, th -w<x<m,1>0 (4) &— Kix = f(x, O<x<€1>0 

u(x, 0) = A(x) u(x,0)= A(x), 40,1) = p(t), u(GO= q(y 
(b) Uy — Kus = f(x, 2) O<x<~,1>0 (e) u— Kux = f(x, 9 O0<x<@1>0 

u(x, 0) a h(x), u(0, t) = p(t) u(x, 0) = h(x), u,(0, t) = p(s), u.(E, t) = a(t) 


(C) Us KU, = f(x, f) 0<x<m, 1>0 
u(x,0)= h(x), u.(0, 9 = p(t) 


8.44 Given £>0, find the Green’s function satisfying 
Gu - a? Gu, = 8(x — £)8(t— 7) x>0, x#€ 
G=0 x=0 
G=0 O<t<7 


8.45 Given ~¢/2< £< €/2, construct the Green’s function obeying 
Ga - a? Gx. = 5(x — E)5(t— 7) C2<x< €/2, x #E 
G=0 forx=+4/2 
G=0 O<t<7r 
(a) by a partial eigenfunction expansion, (b) by the method of images. 


Chapter 9 


Difference Methods 
for Parabolic Equations 


9.1 DIFFERENCE EQUATIONS 


The various partial derivatives of a function u(x, 1) can be expressed as a difference quotient plus 
a truncation error (T.E.). 
Forward Difference for u, 


u(x, tt+k)- u(x, a 


,t)= E. 
u,(% 0) , 
k : . (9.1) 
DES UG 1) (<t<t+k) 
Centered Difference for u, 
+h, t)- ~hy,t 
FC, ee AE 
2h 
2 (9.2) 
TES otek h |) (x-h<¥<xth) 
Centered Difference for u,,. 
(x + h, t)— 2u(x, t)+ —hyt 
U,,(X, 1) = as “ ENS LTE. 
i (9.3) 
ee (x-h<x*<xt+h) 
Centered Difference for u,, 
ee uUxthet+k)—u(xtht—k)-u(x—h,t+k)+u(x—h, Pe ica 
4hk 
h? 2 7 (9.4) 
T.E. = GME 1) tan X's ’) (x-h<kx'<xthti-k<tt'<t+k) 


Usually it is only the order of magnitude of the truncation error which is of interest. A function 
f(h) is said to be of the order of magnitude g(h) as h>0, where g is a nonnegative function, if 
f(A) _ 
m——— = constant 
no &(h) 
In the O-notation we write f(h) = O(g(h)) (h- 0). It is easy to see that if, as h,,h, 20, f, = O(g,) 
and f, = O(g,), then f, + f, = O(g, + g,). 


EXAMPLE 9.1 For (9.1), T.E.= O(k) (k—=0), provided un is bounded. For (9.2), T.E.= O(h?) (h->0), 
provided ux. is bounded. In (9.4), T.E. = O(h? + k”), provided ux and Uae are bounded; we omit as understood 
the (h, k > 0). 


A grid or mesh in the xt-plane is a set of points (x,, t,) = (x) + nh, ty + jk), where n and j are integers 
and (Xp, 4) is a reference point. The (x,, t,) are called grid points, mesh points, or nodes. The positive 
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numbers h and k are respectively the x and ¢ grid spacings or grid sizes. lf h and k are constants, the grid 
is called uniform, if h = k = constant, the grid is said to be square. The compact subscript notation 


u,, = u(x,, t) 


is convenient and widely used. 


EXAMPLE 9.2 The dilference formulas (9.17) and (9.3) may be written 


Mnj+1 — 


ts Xne = m+ Olk) 


2 
Une 7 2Unj + Un Wj Ox Un 


Hxx(Xny Gp) = ———— he Pale an=— 7+ O(n’) 


2 


where the difference operator 52 is the analog of the differential operator 57/8x*. We say that (9.1) is two-level (in 1) 
because it involves only two j-values, these being consecutive. 


Let a region {2 in the xt-plane be covered by a grid, (x,, 4). If all the derivatives in the PDE 
Llu] =f (yf) in Q (9.5) 
are replaced by difference quotients, the result is the finite-difference equation 
DU, =f ef) in Q (9.6) 


The continuous problem (9.5) was differenced or discretized to produce the discrete problem (9.6), 
whose solution, U,,, approximates u(x, f) at the grid points. 


9.2 CONSISTENCY AND CONVERGENCE 


If discretization is to provide a useful approximation, the solution to (9.5) should very nearly 
satisfy (9.6), when # and k are taken sufficiently small. The amount by which the solution to L[u| =f 
fails to satisfy the difference equation is called the local truncation error; it may be expressed as 


T,, = D| u,,| =f, 
The difference equation (9.6) is said to be consisient with the PDE (9.5) if 


lim T= (9.7) 


With the exception of the DuFort-Frankei method (Problem 9.10), all difference methods to be 
treated are consistent with their corresponding PDEs. 
In addition to consistency, we want the accuracy of the approximation to improve as h, k 30. If 
U,; is the exact solution to (9.6) and u,, is the solution of (9.5) evaluated at (x,, 4). the discretization 
error is defined as U,, — u,,. The difference method (9.6) is said to be convergent if 
lim [U,,—4,,|= 0 (x,. 4) in O (9.8) 


hh, k-0 


It is possible for a difference method to be consistent but not convergent. 


9.3. STABILITY 


Let U,, satisfy (9.6), with initial values U,, and possibly boundary values prescribed. Let V,, be 
the solution to a perturbed difference system which differs only in the initia} values, and write 
Vio = Ut E,o. Then, assuming exact arithmetic, the initial perturbation, or “error,” E,), can be 
shown to propagate, with increasing /, according to the homogeneous difference equation 
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DIE,] = 0 


subject to homogeneous boundary conditions. 

When applying (9.6) to approximate u(x, T) for fixed 7 = 4,+ jk, it is clear that letting h,k>0 
entails letting j >. Also, on a fixed grid, if we apply (9.6) to approximate u(x,, &) at successively 
larger 4, then again we have the case j>© to consider. For a PDE with a bounded solution, the 
difference method (9.6) is said to be stable if the E,, are uniformly bounded in n as j >; 1e., if for 
some constant M and some positive integer J 


JEI<M = (j>J) (9.9) 


If h and k must be functionally related for (9.9) to hold, the difference method ts conditionally stable. 
When the PDE has a solution that is unbounded in 4, the stability condition (9.9) is relaxed to allow 
errors 10 grow with the solution (see Probiem 9.7). 

One of the concerns in applying a difference method is whether or not rounding errors in the 
calculation grow to such an extent that they dominate the numerical solution. When a stable method 
is used, rounding errors do not generally cause any difficulties. 

It is usually easier to check a difference method for consistency and stability than for con- 
vergence. Fortunately, stability and convergence are equivalent for a large class of problems. 


Theorem 9.1 (Lax Equivalence Theorem). Given a well-posed initiai-boundary value problem and a 
finite-difference problem consistent with it, stability is both necessary and sufficient for 
convergence. 


In certain cases (e.g., Problem 9.11) the boundary conditions imposed on (9.5) make themselves 
felt as modifications in the form of the operator D[ | of (9.6), as it applies at grid points adjacent to 
the boundary. Let us agree to call U,, an extended solution of (9.0) if it satisfies the equation for the 
unmodified operator; an extended solution would be an actual solution in the event that (9.5) held 
over the entire xf-plane. 


von Neumann stability criterion. A difterence method for an initial~-boundary vaiue problem with a 
bounded solution is von Neumann stable if every extended solution to D[U,,] = 0 of the form 


U,, = €e”" (B veal, € = (8) complex) 


has the property ||<1. For a problem with an unbounded solution, the criterion becomes ([é/= 
1+ O(k). 

For a rationale of the von Neumann criterion, see Problem 9.5. Stability in the von Neumann 
sense Is a necessary condition for stability in the general sense of (9.9); moreover, 


Theorem 9.2: For two-level difference methods, von Neumann stability is both necessary and 
sufficient for stability. 


Consider an initial-boundary value problem with N nodes in the x-direction and define a column 
vector of errors at level j, E; = (E,;, E2), Fy, ---, Eig) For two-level difference methods, the errors 
at levels j and j + 1 are related by 

E41 = CE, 
where Cisan N x N matrix. Let p(C), the spectral radius of C, denote the maximum of the magnitudes of 
the eigenvalues of C, 


Matrix stability criterion. A two-level difference method for an initial-boundary value problem with 
a bounded solution is masrix stable if p(C)< 1. For a problem with an unbounded solution, the criterion 
becomes p(C)=1+ O(k). 


Matrix stability is a necessary condition for the stability of a two-level method. Furthermore, 


Theorem 9.3: Let C be symmetric or similar to a symmetric matrix, whereby all eigenvalues of C 
are real. Then matrix stability is necessary and sufficient for stability. 


CHAP. 9] DIFFERENCE METHODS FOR PARABOLIC EQUATIONS 127 


Although a matrix stability analysis incorporates the boundary conditions of the problem (as 
reflected in the form of C) whereas a von Neumann stability analysis neglects the boundary 
conditions, the conclusions reached regarding the stability of a difference method are nearly always 
the same. This indicates that the stability of a method is determined more by the character of the 
difference equations than by the way in which the boundary conditions are accounted for. 


9.4 PARABOLIC EQUATIONS 
The one-dimensional! diffusion equation, 
u,= au, (9.10) 
(to avoid confusion between « and k we write a’ for the diffusivity) is used as a guide in developing 
finite-difference methods for parabolic PDEs in general. For the grid (x,, t,) = (nh, jk), we shall state 


three commonly used difference equations for (9.10). All three are two-level equations whereby the 
solution, known at level j, is advanced to level j + 1. 


Explicit (Forward-Difference) Method 
U jer Uy _ a Gri 2U,5 + O51} 

k h? 
et Ur = (Ut r8)U, (r= a’ksh’) 


(9.11) 


Implicit (Backward-Difference) Method 
Ui 7 Uy ge U aig 20 at Use 
k h? 
or (- r82)U U, (r=a’k/h’) 


njti “nj 


(9.12) 


Implicit (Crank—Nicolson) Method 
U,, a OU POU 
k 2 h? 
(9.13) 
1 r & = r 2 oy jad hh? 
or ~ 582) Unis = (145 82) Uy (r= a?kih?) 


Theorem 9.4: The forward-difference method (9.11) has local truncation error O(k +h”); it is 
(conditionally) stable if and only if r= 1/2. 


Theorem 9.5: The backward-difference method (9.12) has local truncation error O(k +h’); it is 
stable. 
Theorem 9.6: The Crank-Nicolson method (9.13) has local truncation error O(k’ + h’); it is stable. 
For the two-dimensional] diffusion equation, 
u, = a’(u,, + u,,) (9.14) 


let (x, Yat) = (mh, nh, jk) and U,,, ~ u 
parts: 


ni = U(X Ya» Gj). The above methods have as their counter- 


m 


Explicit (Forward-Difference) Method 
Unajs = 1+ (82+ 5) Unni (r = a’kjh’) (9.15) 
Implicit (Backward-Difference) Method 


[1 — (8+ S)]U, U, (r=a’k/h’) (9.16) 


mnjtl mnj 
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Implicit (Crank—Nicolson) Method 
r r 
E -2 (8+ | U wnat = E +5 (e+ | Uy (r= a?k/h?) (9.17) 


Theorem 9.7: The forward-difference method (9.15) has local truncation error O(k +h’); it is 
(conditionally) stable if and only if rs 1/4. 


Theorem 9.8: The backward-diflerence method (9.16) has local truncation error O(k +h’); it is 
stable. 


Theorem 9.9: The Crank-Nicolson method (9.17) has local truncation error O(k? + h’); it is stable. 


As a class, the explicit methods enjoy the property of directly marching the solution forward in 
time, from one level to the next. They apply either to pure initial value problems or to initial- 
boundary value problems, but suffer the drawback of conditional stability. On the other hand, the 
implicit methods, which are stable, require (in effect) a matrix inversion at each step forward in time. 
Thus, these methods are applicable only to initial-boundary value problems with a finite number of 
spatial grid points. 

For the one-dimensional implicit methods (9.12) and (9.13), the matrix to be inverted is 
tridiagonal; for the two-dimensional (9.16) and (9.17), pentadiagonal. Alternating-direction implicit 
(ADI) methods for parabolic problems in x,, x,,... preserve the tridiagonal feature by first solving a 
sequence of one-dimensional] difference equations in x,; then a sequence in x,,; and so on. Thus, if 
Dirichlet boundary conditions are specified for (9.14); if m =0,1,2,...,M; andifn=0,1,2,...,N; 
then we have (r = a°k/h’): 


Peaceman—Rachford ADI Method 
Poa * roo 
(1~5 62) Scat (1+58) Ge. Wee NED 


2 
(9.18) 


Poo Pao * 
(1 -5%) U sant = € o)) Urn  (m=1,2,...,M-1 
Theorem 9.10: The Peaceman—Rachford ADI method (9.18) has local truncation error O(k* + h’); 
it is stable. 


With only slight modifications, the above difference methods become applicable to the general 
linear parabolic PDE. 


Solved Problems 


9.1 Derive the difference formula (9.2). 


By Taylor’s theorem, 


2 3 


h h 

ux +h, = ule D+ ual Dh + ta + Maal SD (1) 
h? i 

u(x — A, 1) = u(y, t)— u(x, OA + ua (x, Je Uxxx(X, ae (2) 


where x << ¥<x+h andx-—h<%< x. Subtracting (2) from (7) and solving for u, yields 


+h, t)- —h,t h? 
ux, 8) = ee [oa (% £) + Masel & O15 
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9.2 


9.3 


If tux is continuous, the mean-value theorem implies that 


Uxex (X, f) + Ugex(%, 1) 
2 


Ure (Kt) (F< ¥ < ¥£) 
and (9.2) results. 
Derive a difference formula similar to (9.2) in the case of a nonuniform grid, 


Xin) 7 x; + hi 


By Taylor’s theorem, 


1 
U(Xie1, = UG, OF ue, Dhiai + 5 Uxe(X;, hPa + O(h}A (J) 


u(%-1, = U(X, D— UG, Ohi + : Uxx (4, A? — O(h?) (2) 


Subtracting (2) from (7) gives 


u(X%ie1, t)— U(%i-1, ft) 1 O(his1)+ O(h?) 
ie (Xiy 0) = = (xi, teat — i) + 3 
a G ) hist oe h; 2 ue M : ) hist + h; ( ) 


Note that in (3) the dominant term in the truncation error is O(hi+1— h;). To maintain control over the 
truncation error, the grid spacings h; should not be allowed to vary too rapidly with i. 
Multiplying (2) by #; and (2) by #4, and then adding yields 


hihje + his sh? 


hiu(%ie1, ‘+ hiss u(Xi-1, t) = (h, + his)uCa, ‘+ Ux (Xi t) 2 


+ h, O(h3a1) + hist O(h?) 


which when solved for ux. gives 


hiss u(x%-1, t)- (h; + hin )Uu(%i, t+ hyu(xi+1, UA 


TE. 
0.5 (hih2ay + his th?) 


Uxx(%, 1) = 


Show that the explicit method (9.17) has local truncation error O(k + h’). Then show that if 


k 1 
nw 6a’ 
the local truncation error can be reduced to O(k* + h*). 
With (x, 4) = (nh, jk), (9.2) and (9.3) give 


2 


2 
Unj+t— Un Buy = 5 4. 
a 2 Un (Xn; t;) +a Dp Uxcex (Xn, tj) 


k h? 


(u,- ux Yai 


where 4 <4 <4, and X,-1<¥, <Xav1. The amount by which the solution of u,— a7u. =0 fails to 
satisfy the difference equation (9.72) is 


k a 2 
as 5 Mist) er Uxsxx (En ) = O(k + h?) 


provided u,q and ux.. are bounded. 
Now, by Taylor’s theorem and (u, — @7uUxx),j = 0, 


eye Seis ak h? 
a at ap = | Ua ~ a? Hees | + O(k?) + O(h*) (1) 


2 12 : 
Since u, = a7 uyx, Un = A’ Ups = a7(U,)xx Whence 
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9.5 
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Ure = G7(G? Uxx ux = A4 Uerxx 
This shows that the bracketed terms in (J) can be written as 
Keg og *) 
= A A) Ugerx (Xa § 
(5 we) tees Ens) 


which will be zero if we choose k = h*/6a?. 


Show that if r= 1/2, then the explicit method (9.11) is convergent when applied to the 
problem 


u,-— au, =0 O<x<1,4>0 
u(x, 0) = f(x) O<x<l 
uO, 4)= p(t), u0,H)= gi) t>0 


Let © be the region O<x<1,0<¢f<T; take (xn, 5)= (nh, jk) for n=0,1,2,...,N and j= 
0,1,2,...,J4, with Nh = 1 and Jk = T. Let U,, satisfy the difference system 


Un jer = Unj + 182 U pj (r= a?kfh’) 
Uno = f(tn) Uo; = p(s) Un; = 9(f) 


and set wy = U,; -— un. Then w,, satisfies 


ke? _ kh2a? : 
Wjtl = Wai t (1— 27) Way + Wr + o: Un(Xnr, t7) —- D Uerx (Xn, ) (1) 
Wro = 0 Wo, = 0 Wr, = 0 
where § <0; <tr and %,-1 <n < Maan. 
If uw, and uxeex are continuous and if we write 
1 a’ 
A = max ; Un (x, 0) B=max io Uxxxx (4, f) 


for (x, £) in Q, then, since r= 1/2, it follows from (1) that 


|Wrajeal [Wail + (1 — 2r)|way| + 7] wae,|+ Ak7+ Beh? 


<||w,\|+ Ak? + Bkh?  (||w||= max |w,)]) (2) 
O<n< 
From (2) we have 
lw, .1[| S |}w,||+ Ak? + Beh? (3) 


Because ||wol| = 0, (3) implies 
Iwi] = (Ak? + Bkh?) = T(Ak + Bh*) 


which shows that |w,;]/ 0 uniformly in 9 as h, k > 0. 


Use the von Neumann criterion to establish the condition r=1/2 for the stability of the 
explicit method (9.11). 


With (9.17) expressed in the form 
Uy jot = Una + (1 - 2r)U,j + Una) (1) 


suppose that, at level /, an error is introduced at one or more of the x-nodes, perturbing the exact 
solution, U,,, by an amount &,,. If U,; + E,j is used to advance the numerical solution to level /+1, the 
result is the exact solution, U,j4:, plus an error, E,j41. Putting Uy + E,; and Uns1;+ En+t; into (1), 
we see that E,, satisfies that equation. 

Using separation of variables, we identify complex solutions of (J) of the form 
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9.6 


9.7 


a,b, = &/ e'"® (2) 


where é is some (possibly complex-valued) function of the real parameter B. From this, by superposition, 
we are led to the following expression for the error £,,: 


° 


Ew= | Bye dp (3) 


(Strictly, the real part of the integral should be taken.) By a comparison with (6.17), (3) may be 
interpreted as a Fourier integral, representing the error at node a in terms of its frequency spectrum. 
Thus, at level j, the error amplitude corresponding to a given frequency 6/27 is (8). The Fourier-von 
Neumann rule, |é|<= 1, amounts to the prescription that at no frequency should the error amplitude grow 
without limit as j >, 

Substitution of (2) in (1) gives, after division by &/e'™, 


& = re® + (1—2r)+ re”® = 1-2r(1-—cos B) = 1-4r sin? 


and so -1= &=<=1 for all 8B—in particular, for 8 = 7—if and only if Osr=1/2. 


Show that the implicit method (9.12) is (on Neumann) stable. 


The method can be written as 
=U pergart Lt 2NU nye PU pat jer = Uy (1) 
Substituting €/ e" into (1) and dividing by €/ e®", we have 
= 


é[-re® + (1+ 2r)- re"*®] =1 Ses £= (14 4rsin?) 


and we see that |é|<1 for every @ whatever the value of r. 


(a) Modify the explicit method (9.//) to apply to the PDE 
u,= au, + cu (1) 
(6) Make a von Neumann stability analysis of the modified method. 


(a) An explicit difference equation for (J) that reduces to (9.11) when c = 0 is 


Ue eeu 


=a es hig Uy 
k he 
or U nyse =U nity + (1 2rt ck)U,y + rU nar; (2) 
(b) Substituting €’e" into (2), we find 
g=1-4rsin? 4 ck (3) 


If c <0, the solution of (1) is bounded, and the stability criterion is |é|=1 for all B. This is 
satisfied if 


ae 1 n ck (c <0) 
rs-+— es 
2 4 
Note that for c <0 and r= 1/2, (2) is not stable, but the asymptotic stability condition as h, k > 0 is 
r=1/2. 


If c >0, (1) can have exponentially growing solutions, which means that U,,; and its error must 
also be permitted to grow exponentially. Thus, the stability criterion is taken to be 


Jé|= 1+ OfK) 


which is satisfied if again 
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1 ck 
rs-t+— (c > 0) 
2 4 


Now we have (conditional) stability for r = 1/2; once more, the asymptotic stability condition as 
hk -Ois rs 1/2. 


9.8 Show that the eigenvalues of the real, symmetric, tridiagonal, N x N matrix 


Pp q 0 
q Pp q 
eg q Pp q 
q p q 
0 q p 


all lie in the interval [p — |2q|, p + |24]]. 


For C real and symmetric, we know that all eigenvalues are real, and that the largest and smallest 
eigenvalues are the absolute extrema of the normalized quadratic form 


ECE pSit G24 - ++ CA) + 2a Lida t labs t bhatt gwen) 
OE + G4---+2R 
=p+2qR(bi, o2...-, on) 
Now, by Cauchy’s inequality, 


ISidat Loa Uabat ++ bn ln P S (CTF G40 + ORME + G+ ++ + CR) 
< (C3 + 34+ -+-+ ORY 


which implies that |R|<1 and yields the desired interval. 
From the fact that 


1 
BG Geile athe R(@, -a a, ...,+a@)= -1+— 
we derive the inequalities 
[24| 
(p + [24]) ——— S Amax = p+ [2q| 
N 
2¢| 
pO [2q| = Amin = (Pp - [2q]) + 
N 
These show that the estimates 
Amax = p t+ |2q| Amin = P — [24| (7) 


are not necessarily sharp, even as N >, since q can—and, in applications, usually does—vary with N. 
In consequence, when (/) is used to investigate the stability of matrix C, it provides a conservative 
condition, Indeed, it is possibile that the exact values Of Amiq and Amex, from Problem 11.11, can be used 
to establish stability when ({) guarantees nothing. These same remarks apply to the Gerschgorin Circle 
Theorem (Problem 9.26). 


9.9 Use the matrix stability criterion to show that the explicit method (9.17) is stable when 
applied to the initial-boundary value problem 


u,= a°u,, O<x<1,¢>0 
u(x, 0) = f(x) 0<x<1 
u(0,2)=u(1,oj=0 t>0 


if and only if r= 1/2. 
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Let (x,, §) = (nh, jk) (n =0,1,2,...,N;7=0,1,2,...), with Nk = 1, and define a column vector 
U; by 


U; 4 | 4, U2;, U3,, sey Uni] 


The explicit method (9.1/7) can be expressed in matrix form as 


Uys = CU; Gg =0,1,2,3,...) () 

where Uo = [fi, fa, fa. --.fx-1]” and C is the (N — 1) (N ~ 1) tridiagonal matrix 

[ (1-2r) r 0 

r (1 —2r) r 
c= r (1- 2r) r 
r 0 -2r) r 
{| 0 r (1 —2r) 

Suppose that at time level j errors E,, are introduced at x, (n=1,2,...,N-—1), perturbing the 


solution of (1) to U,+ E,, where E; is a column vector with nth component E,,;. Then, using (1) to 
advance the solution, we have 


Uj+it E41 = CU, + CE, or E,+1 = CE; 
or, after mm steps, 
Ejsm = C”E, (2) 
Let Au, A2,..., An-1 and V,, V2,..., Ww-1 be the eigenvalues and associated Jinearly independent 


eigenvectors of the symmetric matrix C. Writing E; as a linear combination of the V;, 


E; _ Ss ar Vx 

ko 
and using (2) and CV, = Ax Vx, we see that 

N-1 

Ejim = >) AL aKVi (3) 

kal 
Equation (3) shows that the errors E,; remain bounded if and only if |A,{=1 for k=1,2,...,N—1. By 
Problem 9.8, with p = (1—2r) and q=,r, 

Amox © (1 — 2r)+ [2r] = 1 Amin * (1 — 2r)- [2rF)=1-4r 


which yields the condition 1—4r=-1, or r<1/2. (This same condition is obtained when the exact 
expressions for the eigenvalues, from Problem 11.11, are employed.) 


A stable (see Problem 9.20) overlapping-steps method is the DuFort-Frankel method, 


U jet U jt 2-7? U nay (Union t U yt U ej (9.19) 
2k h? 
(a) Show that (9.19) is consistent with u, = a7u,, only if 
ok 
lim ~=0 
h,k>0 


(b) Show that if k/h is held constant as h, k > 0, then (9.19) is consistent with an equation of 
hyperbolic type. 


If the more natural central term —2U,; were taken in (9.19), the method would be unstable for 
every positive r= a?k/h?. 
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(a) From (9.2) (for u,) and (9.3), 
Unjri— Unj-i 
2k 


Upn-1,j — 2Uryj t+ Uns; 


h? 


= u, (Xn, + O(k?) (1) 


= Use (Xn, G+ OK?) (2) 


Further, Uaja1+ Unjor = 2Uy + k?un(%n, §) + O(k*); so that (2) gives 


2 4 


Uxx(Xn, tj) — “, Urn(Xn, t)+ O(h?)+ O (5) (3) 


Un-1,j — Unjrr — Uny-1 t Uns; 


h? 


Equations (1) and (3), together with u, = a7u,., show that u fails to satisfy (9.19) by an amount 


2 4 


k k 
Try = a Un(Xn, 4) + O («2+ h?+ =) (4) 
It follows that (9.19) is consistent with the diffusion equation only if k/h tends to zero along with k and 
h. 
(b) If k/k =e, then it is obvious from (4) that (9.19) will be consistent with the PDE 


U, — G7 Uz + ae? Uy = 0 


Using centered differences to approximate all x-derivatives and the implicit method (9.22), 
derive difference equations for the Neumann initial-boundary value problem 


u,= au, O<x<1,1>0 
u(x, 0) = f(x) O<x<1 
4,(0, )= p(t), 4, N=) t>0 


Let (xn, 4) = (nh, jk) (n= -1,0,1,2,...,N-1,N,N4+1;7=0,1,2,..., with Nh =. The ghost 
points x_, and xn+, are introduced so that the boundary conditions can be approximated via the centered 
differences 


Suu s- = p(s) Se fs EO) (1) 
By (9.12), the linear equations for the unknowns U,j+1 are 

—rU nije tt 27U nya — TU naj = Uny (n =0,1,...,N) 
From these, U_1;+1 and Uy.1,;41 may be eliminated by using (1) to write 


Uy jar = U4 jai — 2hp jar U newt jor = UNn-ijsit 2hgja1 


The resultant system is expressed in matrix form as 


(1+ 2r) -2r 0 Vo jet Uo; — 2hrpj+1 
—r (1+ 2r) —r U 1 jst Uy 
-r (1+ 2r) -r Uajer | U2, 
-r (1+ 2r) —r Un-iy+t Un-1,) 
0 —2r (1+ 2r) Un j+t U nyt 2hrqj+i 


Observe the two anomalous entries, —2r, in the transition matrix, which arise from the Neumann 
boundary conditions. 


9.12 Write a computer program that uses the explicit method (9.11) to approximate the solution to 
u, = Uy, O<x<1,1>0 
u(x, 0) = 100 sin ax O<x<1 
u(0, )= u(l, j=0 t>0 
At = 0.5 compare the numerical results with those from the exact solution, 
u = 100 e°”” sin ax 


A FORTRAN-77 program, EHEAT, is listed in Fig. 9-1. Two stable runs are given in Fig. 9-2. The 
excellent agreement between the numerical and exact solutions in the case r~1/6 is explained in 
Problem 9.3. 


PROGRAM EHEAT 
TITLE: DEMO PROGRAM FOR EXPLICIT METHOD 
FOR HEAT EQUATION, UT = KAPPA*UXX 
INPUT: N, NUMBER OF X-SUBINTEAVALS 
K, TIME STEP 
TMAX, MAXIMUM COMPUTATION TIME 
KAPPA, DIFFUSIVITY VALUE 
(X1,X2}, X-INTERVAL 
P({T), LEFT BOUNDARY CONDITION 
Q(T), RIGHT BOUNDARY CONDITION 
F(X), INITIAL CONDITION 
E(X,T), EXACT SOLUTION 
OUTPUT: NUMERICAL AND EXACT SOLUTION AT T=TMAX 
COMMON U(D:251),V([0251) 
REAL K, KAPPA 
DATA T,X1,X2,KAPPA/0,0,1 417 
P(T) =0 
a(t) =o 
F(X) = 100*SIN(PI*X) 
E(X,T]) = 100*EXP[-Pi*PI*T) *SIN(P1*X] 
PARINT*, "ENTER TMAX,NUMBER OF X-SUBINTERVALS AND TIME STEP! 
READ*, THAX,N,K 
H = (X2-X1}/N 
R = KAPPA*K/H/H 
PI = 4*ATAN(1.) 
C SET INITIAL CONOITION 
00 10 I = 0,N 
X = Xi + I*h 
V(I) = FOd 
10 CONTINUE 


QANQNANKAKNIAnAHAaA 


15 DO 20 I = 1,N-1 
u(I) = V[I) + A*(V(1+1) -2*v(1I) + V{I-1)) 
20 CONTINUE 
T=T+kK 
u[O) = P({T) 
U(N) = O[T) 
C WRITE U OVER V TO PREPARE FOR NEXT TIME STEP 
DO 30 I = O,N 
V{I) = U[T) 
3D CONTINUE 
C IF T I§ LESS THAN TMAX, TAKE A TIME STEP 
IF(ABS( TMAX-T) .GT.1K/2) GOTO 15 
C OTHERWISE, PRINT RESULT 
WRITE (6,100) 


WRITE(6,110) N,K, TMAX 
WRITE(6,120) T 
Do 40 I = O,N 
x = 1 + I*H 
EXACT = E[(X,T) 
WRITE(6,130) X,U[1}, EXACT 
40 CONTINUE 
100 FORMAT([///,19,'RESULTS FROM PROGRAM EHEAT ,/) 
410 FORMAT('N =',14,1715,'K = ',F8.6,130,'TMAX =',F5.2,/) 
120 FORMAT('T = ',F5.2,718,'NUMERICAL',T35, 'EXACT',/) 
130 FORMAT( 'X = ',F4.1,119,F13.6,130,F13.6) 
END 


Fig. 9-1 
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N= 10 K = 0.001667 TMAX = 0.50 
T= 0.50 NUMERICAL EXACT 
= 0. 0. 0. 

X= 0.1 D.222262 0.222242 
X= 0.2 0.422767 0.422730 
X= 0.3 0.581889 0.581838 
X= 0.4 0.684051 0.689992 
X= 0.5 0.719254 0.719192 
X= 0.6 0.684051 0.683992 
X= 0.7 0.581889 0.581838 
X= 0.8 0.422767 0.422730 
X= 0.9 0.222262 0.222243 
X= 4.0 0. 0.000000 
N= 10 K = 0.005000 MAX = 0.50 
T= 0.50 NUMERICAL EXACT 
X= Q, 0. 0. 

X= D4 0.204463 0.222242 
X= 0.2 0.388912 0.422730 
X= 0.3 0.536292 0.581838 
X= 0.4 0.629273 0.683991 
X= 0.5 0.661657 0.719191 
X= 0.6 0.629273 0.683991 
X= 0.7 0.535292 0.581838 
X= 0.8 0.388912 0.422730 
X= 0.9 0.204483 0.222242 
X= 1.0 0. 0.000000 

Fig. 9-2 


For the initial-boundary value problem 


u, = au,, O<x<1,1>0 
u(x,0)= f(x) O<x<1 
u(0, = p(), ul, O=q(t) #>0 


show how to imbed the implicit method (9./2) and the Crank—Nicolson method (9.1/3) in a 
single algorithm. 


With (x, 4)= (nh, jk) (n=0,1,...,N;7=0,1,2,...;Nh=1), Jet Uno=f(x,) (n=1,2,..., 

N — 1), Uoo= [f(0) + p(O)1/2, Uno = [f(1) + 9(0)]/2; further, for j= 1,2,..., let Uoj = p(y), Unj = a(4)). 

In the implicit and Crank—Nicolson methods a system of linear equations must be solved to advance the 

solution from 4 to tj4;: it is not possible simply to march the solution forward as in the explicit method. 
The weighted-difference method, 


Unjri— Uy = [A - w)82U + w82U a j41] (r = a?k/h’) (9.20) 


reduces to (9.12) when w=1 and to (9.13) when w=0.5. Incorporating the boundary and initial 
conditions into (9.20), we find that the unknowns U1j41, U2je1,..., Un-1j+1 satisfy the following 
tridiagonal system: 


(1+2wr) —wr 0 Uji Dy 
—wr (1+ 2wr) —wr U2, j41 Dy 
—wr (1+ 2wr) —wr U3,;41 = Ds 

—wr (1+ 2wr) —wr U n-2,j41 Dn-2 

0 —wr (1+ 2wr) LUn-1yer Dn-1 
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where D, =U,;+(l-w)r82U,,  (n =2,3,...,N—2) and 


D,=U 


yt (1- w)rd62?U 1, + wrU 0 j41 Dwi = Un-1j+ (1 w)r82U nai, + WU wot 
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The weighted-difference method program is given in Fig. 9-3. Two runs are shown in Fig. 9-4. Compare 
these with the first run in Fig. 9-2. 
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PROGRAM IHEAT 
TITLE: DEMO PROGRAM FOR IMPLICT AND CRANK- 

NICOLCON METHODS FOR UT = KAPPA*UXX 
INPUT: N, NUMBER OF X-SUBINTERVALS 

K, TIME STEP 

TMAX, MAXIMUM COMPUTATION TIME 

KAPPA, DIFFUSIVITY VALUE 

(X1,X2), X-INTERVAL 

P(T), LEFT BOUNDARY CONDITION 

Q(T), RIGHT BOUNDARY CONDITION 

F(X}, INITIAL CONDITION 

E(X,T}, EXACT SOLUTION 

W, W=1 FOR IMPLICIT—w=,5 FOR CRANK-NICOLSON 
OUTPUT: NUMERICAL AND EXACT SOLUTION AT T=TMAX 
COMMON/BLOCK1/A[51) ,B(51) ,C(51),0(51),L 
COMMON/BLOCK2/U (0:51) 
REAL K, KAPPA 


0 

F(X] = 100*SIN(PI*X] 

E(X,T) = 100*EXP[-PI*PI*T} *SIN[PI*X) 

PRINT*, ENTER TMAX,NUMBER OF X-SUBINTERVALS AND TIME STEP! 

READ*, TMAX, N, K 

PRINT*, "ENTER 1 FOR IMPLICIT, .5 FOR CRANK-NICOLSON METHOD’ 

READ*, W 

H = (X2-X1)/N 

A = KAPPA*K/H/H 

PI = 4*ATAN(1.) 

SET INITIAL CONDITION 

DO 10 I = 0,N 
X= X41 + I*H 
U(I) = FX] 

CONTINUE 

DEFINE TRIDIAGONAL LINEAR SYSTEM 

L += N-4 

DO 20 I 
A(T) 
BI} 
c(i) 
D(I) 

CONTINUE 

CALL TRIDIAGONAL LINEAR EQUATION SOLVER 

CALL TRIDI 

WRITE SOLUTION AT TIME T+K INTO THE U-ARRAY 

T=T+K 

DO 30 I 
U(T) 

CONTINUE 

u(o) = P{T) 

u(N) = a{T) 

IF T IS LESS THAN TMAX, TAKE A TIME STEP 

IF(ABS{TMAX-T).GT.K/2) GOTO 15 

OTHERWISE, PRINT RESULT 

WRITE(6,100) W 

WRITE(6,110) N,K,TMAX 

WRITE(6,120) T 

DO 40 I = O,N 


41,L 

—W*R 

1 + 2*w*A 

—w*R 

U(I) + (1-W)*A*(U[I-1] - 2*uU[I) + U[1+1)}} 


1,N-1 
D(I) 


Fig. 9-3 (Program continues on next page) 
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X = X1 + 17H 
EXACT = E(X,T) 
WRITE(6,130) X,U(I),EXACT 
40 CONT INUE 
400 FORMAT(///,714,'RESULTS FROM PROGRAM IHEAT W=',F5.2,/) 
110 FORMAT('N =',14,715,'K = ',F8.6,1390,'TMAX =',F5.2,/) 
120 FORMAT('T = ',F5.2,1718,'NUMERICAL',135, ‘EXACT’ ,/) 
130 FORMAT( 'X = ',F4,1,113,F19.6,130,F13.6) 
END 
SUBROUTINE TRIDI 
COMMON/ BLOCK1/A(51) ,B8(51) ,C({51) ,D(51),L 
C TITLE: TRIDIAGONAL LINEAR EQUATION SOLVER FOR 
Cc A SYSTEM WITH A NONZERO DETERMINANT 
Cc INPUT: A, SUBDIAGONAL OF COEFFICIENT MATRIX 
c B, DIAGONAL OF COEFFICIENT MATRIX 
Cc C, SUPERDIAGONAL OF COEFFICIENT MATRIX 
Cc D0, RIGHT HAND SIDE OF LINEAR SYSTEM 
c L, NUMBER OF LINEAR EQUATIONS 
c GQUTPUT: SOLUTION OF LINEAR SYSTEM STORED IN D-ARRAY 
c FORWARD SUBSTITUTE TO ELIMINATE THE SUBDIAGONAL ELEMENTS 
0011 = 2,L 
RT = -A(1I}/B{I-1) 
B(I) = B(I) + RT*C(I-1) 
D(I) = D(I) + AT*O(I-1) 
1 CONT INUE 
C BACK SUBSTITUTE AND STORE THE SOLUTION IN D-ARRAY 
D(L) = D(L)/B(L) 
DD 2 I = L-1y1y-1 
D(I) = (D(1} - C(I) *D(I+1))/B(T) 
2 CONTINUE 
RETURN 
ENO 
Fig. 9-3 (Continued) 
»5 -- CRANK-NICOLSON METHOD W = 1.00 — IMPLICIT METHOD 
10 K = 0.005000 TMAX = 0.50 N= 10 K = 0,005000 TMAX = 0,50 
0.50 NUMERICAL EXACT T= 0.50 NUMERICAL EXACT 
o. 0. oO. x= 0. 0. 0. 
0.1 0.231190 0.2P2242 X= O.1 0.259879 0.222242 
0.2 0.439749 0,422730 X= 0.2 0.494319 0.422736 
0.3 0.605262 0.581838 x= O,9 0.680372 0.581838 
0.4 0.711528 0.883991 X= 0.4 0.789825 0.683991 
0.5 0.748145 0.718191 X= O.5 0.840986 0.719181 
0.6 0.711528 6.883991 X= O.68 0.799825 0.683991 
0.7 0.605262 0.581838 x= O.7 0.680372 0.581838 
0.8 0.439749 0.422730 X= 0.8 0.494319 0.422736 
0.9 0.231189 0.222242 X= O.9 0.259879 0,222242 
1,0 q, 0.000000 X= 1.0 0. 0.000000 


Write a computer program that uses the Peaceman-Rachford ADI method (9.18) to 
approximate the solution of 


U, = U,, + Uy O<xy<1,2>0 


u(x, y, 0) = 100 sin ax sin ay O<xy<1 
u0,y,j=ud,y)y=0 O<y<l,e>0 
u(x, 0, 1)= uly, 1, )=0 O<x<1,t>0 


Compare the numerical solution with the exact solution, u = 100e— 


Qn? 


‘sin mx sin ay, at r= 0.1. 


For a program, see Fig. 9-5. Though the symmetry of the solution was not exploited in constructing 
the program, the numerical results do display the expected symmetries. It therefore suffices to compare 


the numerical and exact solutions on O< y= x,0<x =< 1/2. See Fig. 9-6. 
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PROGRAM ADI 
TITLE: DEMO PROGRAM FOR ADI METHOD FOR 
UT = KAPPA*(UXX + UYY) 
INPUT: MMAX & NMAX, NUMBER OF X & Y-SUBINTERVALS 
K, TIME STEP 
TMAX, MAXIMUM COMPUTATION TIME 
KAPPA, DIFFUSIVITY VALUE 
(x1,X2) & (Y1,Y2], X & Y-INTERVALS 
P1(Y,T] & G1(Y,T)], LEFT & RIGHT BOUNDARY CONDITIONS 
P2(X,T) & G2(X,T},UPPER & LOWER BOUNDARY CONDITIONS 
F{X,¥), INITIAL CONDITION 
E(X,Y,T), EXACT SOLUTION 
OUTPUT: NUMERICAL AND EXACT SOLUTION AT T=TMAX 
COMMON/BLOCK1/A(51),B(51) ,C(51) ,D(51) ,L 
COMMON/BLOCK2/U(0:51,0:51),V(0:57,0:51) 


REAL K, KAPPA 

DATA T,X1,X2,Y1,Y2-KAPPA/O ,091 9091 p1/ 
P4(Y,T) = 0 

ai(Y,T) =o 

P2(xX,T] = 0 

a2(X,T) =0 


F(X,Y) = 100*SIN(PI*X) *SIN[PI*Y) 

E(X,Y,T) = 100*EXP({-2"PL*PI*T) *SIN(PI*X) *SIN[PI*Y) 
PRINT*," ENTER TMAX AND TIME STEP" 

READ*, TMAX, K 


PRINT*,'ENTER NUMBER OF X-SUBINTERVALS, NUMBER OF Y-SUBINTERVALS' 


READ*, MMAX, NMAX 
SET INITIAL CONDITION 


PI = 4*ATAN(1,) 
HX = [X2-X1] /MMAX 
HY = [Y2—-Y1)/NMAX 
DO 10 M = O,MMAX 
DO 10 N = 0,NMAX 
X = X1 + MPHX 
Y = Y1 + N*®HY 
U{M,N) = 100*SIN(PI*X) *SIN(PI*Y) 
CONTINUE 


CALCULATE INTERMEDIATE VALUES SWEEPING VERTICALLY 
RX = KAPPA*K/HX/HX 
DO 20 N = 1,NMAX-1 

Y = Y1 + N*¥HY 


DO 30 M = 1,MMAX-1 
A(M) = -—.5*RX 
B(M) =1 + RX 
C(M) = —.5*AX 
D(M) = .5*AX*(U(M-1,N)+U(M+1,N)) + (1-RX]*U[M,N) 


SOLVE TRIDIAGONAL SYSTEM FOR VALUES ON N-TH HORIZONTAL LINE 
L = MMAX -1 
CALL TRIDI 
WRITE INTERMEDIATE VALUES INTO THE V-ARRAY 
DO 40 M = 1,MMAX—1 
V(M,N) = D{M) 
CONTINUE 
v(c,N} = P1[y,T) 
V(MMAX,N) = Q1(Y,T) 
CONTINUE 
CALCULATION OF INTERMEDIATE VALUES IS COMPLETE 
BEGIN HORIZONTAL SWEEP TO COMPLETE THE TIME STEP 
RY = K/HY/HY 
DO 50 M = 1,MMAX—1 
X = X1 + MBHX 


DO 60 N = 1,NMAX-1 

A(N] = -.5*RY 

B(N) = 1 + RY 

C(N) = —,5*AY 

D(N) = .5*AY*(V(M)N-1J+VE€MyN+1)) + (1-RY) *V(M,N} 
CONTINUE 


SOLVE TRIDIAGONAL SYSTEM FOR VALUES ON M-TH VERTICAL LINE 
L = NMAX - 1 
CALL TRIDI 

Fig. 9-5 (Program continues on next page) 
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c WRITE T+K VALUES INTO THE LHARRAY 
DO 70 N = 1,NMAX-4 
U(M,N) = D[N) 
70 CONTINUE 
U(M,O) = Pe[x,T) 
u(M,NMAX) = Q2(X,T) 
50  GONTINUE 


C TIME STEP IS COMPLETE 
T = T+K 

C IF T IS LESS THAN TMAX, TAKE ANOTHER TIME STEP 
IF(ABS{ TMAX-T) .GT.K/2) GOTO 15 

Cc IF T EQUALS TMAX, PRINT RESULT 
WRITE(6,100) 


WRITE(6,110) MMAX,NMAX,K, TMAX 
WRITE(6,120) T 
DO 80 M = 1,MMAX/2 
DO 80 N = 1,M 
X = X1 + MPHX 
Y= Y4 + N®HY 
EXACT = E[X,Y,T) 
WAITE[6,130) M,N,U(M,N) yEXACT 
80 CONTINUE 
400 FORMAT{///,79,'RESULTS FROM PROGRAM ADI' ,/) 
110  FORMAT('MMAX=',I2,' NMAX=',I2,718,'K = ',F5,.2,730,'TMAX =',F5.2,/]) 
120 FORMAT('T = ',F5.2,118,'NUMERICAL', 135, 'EXACT',/) 
130 FORMAT( 'M,N = ',11,',',114,113,F13.6,1730,F13.6) 
END 
SUBROUTINE TRIDI 
COMMON/BLOCK1/A(51} ,B(51) ,C(51),D(51) ,L 
TITLE: TRIDIAGONAL LINEAR EQUATION SOLVER FOR 
A SYSTEM WITH A NONZERO DETERMINANT 
INPUT: A, SUBDIAGONAL OF COEFFICIENT MATRIX 
B, DIAGONAL OF COEFFICIENT MATRIX 
C, SUPERDIAGONAL OF COEFFICIENT MATRIX 
D, RIGHT HAND SIDE OF LINEAR SYSTEM 
L, NUMBER OF LINEAR EQUATIONS 
OUTPUT: SOLUTIDN OF LINEAR SYSTEM STORED IN D-ARRAY 
FORWARO SUBSTITUTE TO ELIMINATE THE SUBDIAGONAL ELEMENTS 
DO4 I = 2,)L 
RT = -A[I}/B(I-1) 
8(I) = B(I} + AT*C(I-1} 
D(I) = D{[I) + RT*D[I-1) 
CONTINUE 
BACK SUBSTITUTE AND STORE THE SOLUTION IN D-ARRAY 
D(L) = D(L)/B(L) 
DO 2 I = L-4,1,-1 
D(I) = (O(1} -— C(I) *D{I+1))/B(1) 
2 CONTINUE 
RETURN 
END 


aqgaagngnIagagAaaNg 
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Fig. 9-5 (Continued) 


MMAX=10 NMAX=10 K= 0. TMAX = 0,10 


T= 0.10 NUMERICAL. EXACT 

M,N = 151 1.948013 4.326484 
MyN = 251 2,560268 2.523122 
M,N = 2,2 4.869920 4.799263 
M,N = 3,1 3.529907 3.472779 
M,N = 3,2 6.702869 6.605618 
M,N = 3,3 8.225708 9.091854 
M,N = 4,1 4.142601 4.082497 
M,N = 4,2 7879695 7.765370 
M,N = 4,9 10,845469 10.688116 
M,N = 4,4 12.749614 12.564634 
M,N = 5,1 4,9355789 4,292591 
M,N = 5,2 8,285203 8.164993 
M,N = 5,4 11.4038603 41.238150 
M,N = 5,4 13 .405738 13211238 
M,N = 5,5 14,095628 13 .8911417 


Fig. 9-6 
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9.15 


9.16 


For a parabolic initial-boundary value problem, the method of lines consists in discretizing 
only the spatial variables to obtain a system of ordinary differential equations in ¢. Illustrate 
the method of lines by applying it to 


u, = U,, O0<x<],t¢>0 (1) 
u(x, 0) = f(x) O<x<1 (2) 
u(0, t)= uJ, 4) =0 t>0 (3) 


Take h = 0.25. 


Let x, =nh (n=0,1,2,3,4) and let U,(t) be an approximation to u(x,, ¢). In (7) approximate u, 
by Ui(t) and ux by 62U,(1) to obtain the following system of ordinary differential equations. 


1 
1 
US Ga ae Us) (4) 
, i 
Us= 73 (U2— 2Us) 


If we look for solutions to the system (4) of the form U, = a,e”, we are led to the following eigenvalue 
problem in A: 


—2 1 0 ay ay 
ho? 1 -2 1 a2 =A a2 (5) 
0 1 -2 ay ay 


By Problem 11.11, the eigenvalues A of (5) are 
kor 
A = ho? (-2+ 2008") (k = 1, 2, 3) 


or Ay = —8+4V2, Az = ~8, As = -8-4V2, with corresponding eigenvectors 
Vee (V2 Vyr V2=[1,0,-1]7 Vas [V2 31,2)" 
The solution of (4) can be expressed as 
[Ui(2), U2(t), Us(O]7 = eV e*" + c2V2 6%" + o3V36% (6) 


and all that remains is to set ¢= 0 and U,,(0) = f(x,) in (6) to obtain three linear equations for ci, C2, Cs. 
In practice, the number of x-nodes is usually much larger than five, and the PDE may have variable 

coefficients or may be nonlinear. In these circumstances it is desirable, or necessary, to obtain an 

approximate solution to the system of ordinary differential equations by a numerical method. 


Supplementary Problems 


In the centered-difference formula (9.2), suppose that the computed values of u(x +h, 1) are &(x +h, £) 
plus rounding errors of magnitude at most ¢. Also, suppose that M is an upper bound for uxix(x, #). 
(a) Show that 

a Ss uh = Z 

a(x th, a(x—h, ft) gia 


(Xt = M 
Hee) 2h hk. 6 


(b) What is the effect of rounding errors as h > 0? 
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Lagrange’s interpolation formula for three points gives 


(x = xi)(¥ = X2) (x — X0)( ~ x2) (x = Xo)(% ~ x1) 


(Xo — X1)(%o — x2) ‘(a Xo)(X1 — X2) : (X2— x0)(x2— x1) 


Uo 


as the quadratic function which assumes the values uo, 4), U2 for the arguments Xo, x1, x2. Choosing 
u;= u(x,t) CG =0, 1,2), use y’(x.) and y” as finite-difference approximations of ux(x1, 2) and Us (X1, 2), 
respectively. Verify that your formulas agree with those of Problem 9.2. 


Prove that the eigenvalues « of C= (I+ B)‘(I— B) are given by 
1-A 


oF es 


where A is an eigenvalue of B. 
(a) Show that errors in the Crank—Nicolson method are governed by 
(I+ B)Ej.. = I- BE; 


where B is a symmetric, tridiagonal matrix with diagonal entries r and sub- and superdiagonal entries 
—7/2. (b) From (a), Problem 9.18, and Problem 9.8, infer the stability of the Crank—Nicolson method. 


Show that the DuFort—Frankel method (9.19) is (von Neumann) stable. [Hint: Establish that 


2rcos B+ V1-—(2rsin B)* 
1+2r 


and consider the cases r = 1/2, r > 1/2 and |2r sin B| <1, r> 1/2 and |2rsin 6] > 1.] 


Show that the Peaceman—Rachford ADI method (9.18) is (von Neumann) stable. [ Hinz: For separable 

solutions of the form €/e8"*”™, show that 

28 
2 


PaOr se 1 sine— 


é= 


ia EOF age 
2 2 


whence |é|= 1. 


(a) Exhibit in matrix form a backward-difference method for the problem 


Uy = Ux ~ U O<x<1,4>0 
u(x, 0) = f(x) O0<x<1 
u(0, 1) = u(1, 1) =0 i>0 


(b) Perform a matrix stability analysis, utilizing Problem 11.11 and the fact that the eigenvalues of C7! 
are the reciprocals of the eigenvalues of C. 


For j = 1,2, exhibit the solution U,; to (9.11) that assumes the initial values U,o = 0 (n = +1, +2,...), 
Uoo = 100. Choose grids with (a) r = 1/4, (b) r = 1 (unstable). 
Show that the explicit method (9.11), when applied to the problem 


Up = G7 Ug, O0<x<1,1>0 
u(x, 0) = F(x) 0<x<1 
ux(0, t) = u.{1, 1) =0 t>0 


on the x-gnd 0= x9<xy<-°+< xy = 1, has the matrix formulation 
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9.25 


9.26 


9.27 


9.28 


Uo, j+1 1-2r 2r 0 Uo; 
Uy j+1 r 1-2r r U,; 
Un-1.j+1 1—2r pr Un-1. 
Un, j+1 0 2r 128) || he 


In Problem 9.24, prove that 


[ u(x, ) dx = ia f(x) dx 


(conservation of diffused material between impermeable walls at x =0 and x= 1) and that, corres- 
pondingly, 


The Gerschgorin Circle Theorem states that if A=[a;,] is an Nx N matrix and C; is the circle in the 
complex plane with center a, and radius 


then all the eigenvalues of A are contained in the union of Ci, G,..., Cy. Use this theorem to show 
that (a) the difference method of Problem 9.24 is stable provided r< 1/2, (b) the difference method of 
Problem 9.11 is unconditionally stable. 


For the problem 


Uy = GA? Uxs O<x<€1>0 
u(x, 0) = f(x) O<x<? 
au(0, 1) + Bu, (0, ) = p(t) 1>0 
u(Gn=qt) +6>0 
where a@ and # ~0 are constants, use the explicit method (9.11) and a ghost point, x-,, to derive a 
difference system for U,; (n=0,1,...,N-—1;/=0,1,2,...). 


For the problem 


u, + Cu, — Q7Uy, = 0 O<x<1,1>0 
u(x, 0)=0 O<x<l 
4#(0,)=1, ui, Hh=0 1>0 


use the backward-difference method (9.12), together with a centered difference for x2,, to formulate a 
difference system for U,; (n= 1,2,...,N—1;/=0,1,2,...). 


Chapter 10 


Difference Methods 
for Hyperbolic Equations 


10.1 ONE-DIMENSIONAL WAVE EQUATION 
Methods similar to those given in Section 9.4 may be used to approximate smooth solutions to 
HS Cy (10.1) 


Let (x,, 4) = (nh, jk) (n,j=0,1,2,...) and write s=k/h; we have as representatives of the two 
sorts of methods: 


Explicit Method 


U, jai 7 2U,, + Chagas 2 Una 7 20 yt tg 
ke = he 
or 8/U,, = 0's 8, U,, (10.2) 
Implicit Method 
SU. =’: b Uj) aa 3 Un )-1 
t ny 2 
or SOS Oat Oe 2O SU aa ics Uns en AO eA OU ce 5 OU) (10.3) 


The local truncation errors given in Theorems 10.1 and 10.2 assume that u is four times continuously 
differentiable in x and t. 


Theorem 10.1: The explicit method (10.2) has local truncation error O(k?+ h’); it is stable if and 
only if c’s° <1. 


Theorem 10.2: The implicit method (10.3) has lacal truncation error O(k? + h); it is stable. 


In Problem 10.1 it is shown how initial conditions are used to evaluate U,, and U,,, which are 
needed to start the calculations in either method. The sorts of problems to which the two methods 
properly apply are as in the parabolic case, assuming smooth solutions. For problems to which the 
solution is not smooth, the method of characteristics usually provides a more accurate numerical 
solution (see Section 10.2). 

The stability condition of Theorem 10.1 is often referred to as a Courant—Friedrichs—Lewy (CFL) 
condition. The CFL condition for the stability of an explicit finite-difference method is that the 
numerical domain of dependence must contain the analytical domain of dependence. Thus, for (10.2) 
to be stable, the backward characteristics through (x,, ,,) must pass between (x,_,, ¢)) and (x,,,, &)- 


10.2; NUMERICAL METHOD OF CHARACTERISTICS 
FOR A SECOND-ORDER PDE 


The Cauchy problem for the quasilinear hyperbolic equation 
au,,+ 2bu,t+cu, =f  (b’> ac) (10.4) 


wherein u, u,, and u, are prescribed along some initial curve I’ that is nowhere tangent to a 
characteristic, becomes a Cauchy problem for a first-order system of the same type when u, and u, 
are taken as new dependent variables. Writing 
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b+VB-ac b-Vb?- ac 


A. =—_— A = 


+ — 


a a 
we obtain from the theory of Chapter 5 (see also Section 10.4) the following basic results for (10.4): 


Theorem 10.3: The level curves of the surfaces z = F(x, y) and z = G(x, y) are respectively the a- 
and B-characteristics of (J0.4) if 


d F. 
=~ +=, along F(x y)=8 (10.5) 
dx Fr, 
Ye its A | G = 10.6 
en ee along (4 y)=a@ (10.6) 


The introduction of @ and B as new coordinates in the vicinity of [ leads to the 
replacement of (10.4) by the system of characteristic equations 


Vg = AX, (10.7) 
Yea AG (10.8) 
A,a(U,), + (Uy) = LV, (10.9) 
A_a(U,)g + (Uy) = f¥p (10.10 ) 

eS Ud, + Wy, (10.11a) 
Ug = UX, + Ug (10.11b) 


The numencal method of characteristics begins with the selection of grid points P, on T (Fig. 
10-1); u(P,), u,(P;), and u,(P,) are therefore known. Next, all @- and 6-derivatives in (10.7)-(10.11) 
are replaced by difference quotients; e.g., 


WHlQ)= uF) | _ (Pas) ~ (Q) 


(4s) Ka 8 AB 


The result, after cancellation of Aa@ and Af, is a system of five algebraic equations in the five 
unknowns x(Q,), y(Q,), u(Q,), 4,(Q,), and u,(Q,). In general, the system is nonlinear and must be 
solved by an iterative technique (see Problem 10.5). With the new grid points Q, located and with 
new starting values at hand, the transition can be made to the A;; and so forth. 


—— Fr, y)=Bi 


G(x, yy=a Bo 


Fig. 10-1 
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In the event that a, b, and ¢ in (/0.4) are independent of u, an a priori integration of the ordinary 
differential equations (10.5) and (10.6) may be possible, yielding the characteristic curves and their 
points of intersection, the grid points. In that case, (10.7) and (10.8) may be dropped from the 
numerical algorithm. 

Only one of the equations (10.//) need figure in the numerical method of characteristics. In the 
case of a pure initial value problem, it is a good idea to check the solution obtained when (10. 11a) is 
used against that involving (40.1/b). For an initial-boundary value problem, in calculations adjacent 
to a boundary, the choice of equations (20.11) is dictated by the relative orientations of the boundary 
and the @- and B-characteristics. See Problem 10.20. 


10.3. FIRST-ORDER EQUATIONS 
We start with the simple equation 
au, + u, =f (10.12) 


where a is a constant and f = f(x, t), because difference methods for (10.12) carry over directly to a 
hyperbolic system of m linear first-order equations in m functions of x and &. Letting (x,, &) = (nh, jk) 
and s = k/h, we have 


Explicit (Forward-in-x) Method 


a Uae Uni 4 Ua Orie 
h k m 
er UL i= (+ 84) 0, — saU ay + Af; (10.13) 


Explicit (Backward-in-x) Method 


Go Goa Us = US 
qwe Sets Suet Sag, 
of U, jst = sau, ; + (1 - sa)U,, a6 Kf (10.14) 


Explicit (Modified Centered-in-x) Method 


4 U1, a Uni, Winn pCi + U,-1,;) =v 
2h k sd 
1+ sa 1-sa 
~ mit a Una ta Ga + hy (10.15) 


Theorem 10.4: The forward-in-x method (10.13) has local truncation error O(k + A); it is stable if 
and only if -1ssa <0. 


Theorem 10.5: The backward-in-x method (10.14) has local truncation error O(k + #4); it is stable if 
and only if 0< sa <1. 


Theorem 10.6: The modified centered-in-x method (10.15) has local truncation error O(k + h?); it 
is stable if and only if |sa|<1. 


It should be noted that the unmodified centered-in-x method, with a simple forward difference in 
time, is always unstable. 

A three-level explicit method for (10.12) can be obtained by estimating both u,(x,, 4) and 
u,(x,, &) by centered differences: 
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Leapfrog Method 


a U taps Una 4 U ae Uy, j-1 = 
ny 
oe fas (10.16) 
OF U,, +t = Uj a saucis = sau; + 2kf,, 


Theorem 10.7: The leapfrog method (10.16) has local truncation error O(k* + h’); it is stable if and 
only if |sa] <1. 


A two-level implicit method results from approximating both partial derivatives as an average of 
forward differences: 
Wendroff’s Implicit Method 


( pS + (Uo ; 4,7 U.)+ ato 
a (Ons nj) S ntl jt U,,jev 5 (Uy, jt U,) eae Oyirs) = f(x, + (A/2), t+ (k/2)) 


or (4 sa)U ag py = 808) U, yo 0 sa)U 4 Ot SQ)U,, FRR apy pany (10.17) 


+L 


Theorem 10.8: Wendroff’s implicit method (10.17) has local truncation error O(k* + h’); it is stable. 


Wendroff’s implicit method cannot be applied to a pure initial-value problem. However, for an 
initial—boundary value problem, (20.17) can be used in an explicit manner (see Problem 10.8). Each 
of the methods (10.13)—(10.17) can be modified to apply to the general quasilinear first-order PDE 
in two independent variables. 

As is shown in Problem 10.4, the scalar conservation-law equation 


[F(u)], + u,=0 (10.18) 
admits the 
Lax--Wendroff Method (Scalar) 


2 
AY ar F 
Fhay)t Gl, +P IE iG Ey) ee Ba Ey) (10.19) 


miy 


AY 
U Use 


njtl nN 2 atl j 
Here, F,, = F(U,,), Fy, = F'(U,,). 

Theorem 10.9: The Lax—Wendroff method (10.19) has local truncation error O(k’ + h’). 

The stability criterion for (10.19) will depend on the function F; if F(uw)=au (a=const,), the 
method is stable if and only if |sa| <1. 

To avoid the calculation of F’, several two-step modifications of (10.19) have been devised. For 


example, 
1 


AY 
Oi = > (Ussig ae Ui 2 (Pg = F,) 
a (10.20) 
U,, jt = U,; 7 s(F%, -_ Fog) 


has the same local truncation error, O(k’ +h’), as (10.19) and reduces to (10.19) in the linear case 
F(u) = au. 
Next, consider the hyperbolic system of M linear first-order equations 


Au, +u, =f (10.21) 
where A is a constant M <x M matrix and 
u = [ete Pais 2)... ., 1% Ol? £= [lx Geb... shale” 
By Section 5.2, all Ad eigenvalues of A are real. The scalar numerical methods (/@.13)-(10.17) 
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become vector numerical methods for (0.21) when a is replaced by A (and 1+ sa by I+ sA), and U,, 
and f,; are replaced by 


UL [UL ap Uy aprers Usa)” fy = Uf np Panporrs ele (10.22) 


Theorems 10.4—-10.8 hold for these vector methods if, in the statements, a is replaced by A, any 
eigenvalue of A. 
Similarly, the Lax—Wendroff method may be extended to handle the conservation-law system 


0 ou 
ay Ne Uy, .--, Uy )+— = 0 
Ou. 
F,(u,, u,,..., U,)+—=0 
of 1 2 Mm) at 
0 OUy, 
By PM (Mi Ho» Uy, ) race 
i.e., the vector conservation-law equation 
[F(u)], +u,=90 (10.23) 


Define the vectors U,, as in (10.22) and write 


BU is ejaxena ig) 
FU Uo pennee vaca) 


A nj? 


Fy (Uy, U, nj teaocy Unig) 


Let J(u,, uy,..., Uy) =[AF,/du,] (p,q =1,2,...,M) be the Jacobian matrix of the functions 
F,,..., Fy, and write 


Inj = ICU jp Varn +> Usanj) 


lap 


Then, for (10.23), we have the 


Lax—Wendroff Method (Vector) 
2 


AY AY 
U,, 41 = U,; 9 (Fai) E<iy) + 4 ((Snat,j + J, Pua F,,) (VJ, ao J, (F,; =I Fay ll (10.24) 


The vector version of the two-step modification (/0.20) avoids calculation of the Jacobian matrix. 


EXAMPLE 10.1 For f = 0, the linear system (10.21) becomes the special case F(u) = Au of (10.23). In this case, 
F,, = AU,,; Jn; = A= const. 
and we obtain for the homogeneous (10.21) the linear Lax— Wendroff method 


2 


Ss s 
Un j+1 = U,; 5 AU en, = Un-as)t > Aner) at 2U ny) + U,.- ra) 


AY Ss 
7 5 AGA —DUn+1,;—(sA—- D(sA+ DU,,; + 5 A(sA +1) Un-1,j (10.25) 
Problem 10.10 treats the stability of (10.25). 
The difference methods presented above, like those of Section 10.1, work best if the exact solution is 


smooth. If discontinuities are present, greater accuracy will be furnished by a numerical method of 
characteristics. 
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10.4 NUMERICAL METHOD OF CHARACTERISTICS FOR FIRST-ORDER SYSTEMS 


The numerical method of characteristics is applicable to initial value problems for either a single 
first-order equation or a hyperbolic system of first-order equations. 
First, consider the quasilinear PDE 


au, + bu, =c (b # 0) (10.26) 


and suppose that uw is given on the noncharacteristic initial curve I’. Let Q be any fixed point on I and 
@ be the characteristic of (10.26) passing through © [Fig. 10-2(a)]. By (4b) of Problem 5.3, 


bdx-ady=0 and bdu-—cdy=0 
along @. Approximating dx, dy, and du by x(P)— x(Q), y(P)— y(Q), and u(P)-— u(Q), we obtain a 
pair of algebraic equations, 
b[x(P)— x(Q)]— aly(P)— y(Q)] = 0 (10.27) 
blu(P)— u(Q)] — c[y(P)— y(Q)] = 0 (10.28) 


After one of the coordinates, x(P) or y(P), of P has been selected, this system determines the other 
coordinate of P and the value of u at P. The system (10.27 )—(10.28 ) is linear only if (10.26) is linear with 
constant coefficients. 


y 
B-characteristic \ 
P . 
a@-characteristic 
Q 
R r 
x 
(6) 
Fig. 10-2 
Next, consider the 2 x 2 quasilinear hyperbolic system 
Au, + Bu, =c¢ (det (B) # 0) (10.29) 


with u= [u, v]” given on I’. Using the theory of Chapter 5 (see especially Problem 5.12) to transform 
from the variables x, y to characteristic coordinates a, 8B, we obtain the canonical equations for 
(10.29): 


X= Ae 
Xg = A2Y~ 
btu, + Biv, = CTY, 
by Ug + bv, = C3 Yp 


where A, and A, are the (by assumption, real) zeros of det (A— AB) and where the starred coefficients 
are known functions of x, y, u, v. Replacing the a- and 6-derivatives by difference quotients (per Fig. 
10-2(5)) yields the following numerical method: 
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x(P)- x(Q)= Aly(P)— y(Q)] (10.30) 
x(P)- x(R) = Ady(P)— y(R)] (10.31) 
bt[u(P)— u(O)] + be v(P)— v(O)] = ct[y(P)- y(Q)] (10.32) 
b3[u(P)— u(R)] + bS[v(P)~ v(R)] = cSLy(P)~ (RI (10.33) 


In general, the algebraic system (/0.30)-(/0.33) must be solved for the unknown x(P), y(P), u(P), 
and v(P) by an iterative procedure. 


10.1 


10.2 


Solved Problems 


Given the initial conditions u(x, 0)= f(x) and u(x, 0)= g(x) for the wave equation (10.1), 
show how to obtain starting values U,, and U,, for the difference methods (10.2) and (10.3). 


The guiding principle here is that the starting values should represent the initial data with an error no 
worse than the local truncation error of the difference method, which in the present case is O(k? +h’). 
Obviously, then, we take U,o = f(x,), as this incurs error zero. 

To decide on U,, let us suppose that f is in C? and that (10.1) holds at t=0. Then Taylor’s 
theorem gives 

k? 
Uu(Xp, 1) = u(X,, 0) + ku, (x,, 0) + s Un (Xn, 0) + Ok?) 


2 


= u(Xn, 0) + kg la)+ ef") + O(k*) 


22 


= u(x,,0)+ kg(x,) + Lf (%n-1) — 2f Con) + f(%n+1)] + O(K*h? + k?) (J) 


2h? 
where, in the last step, f"(x,) has been approximated through a second difference, according to (9.3). 


From (1) it is seen that the relation 


Uni = Uno kc? 
8 (Xn) = —T—— = 5 [FP (An-1) — 2F (Xn) + fGn+1)] (2) 
k 2h 
is satisfied by the exact solution u to within O(kh? + k7); i.e., letting (2) determine U,, results in an error 
of higher order than O(k? + h?). 


Write a computer program that uses the explicit method (10.2), with starting values as in 
Problem 10.1, to approximate the solution to the initial-boundary value problem 


Uu,, — 4U, = 9 0<x<1, t>0 
u(x, 0) = sin 24x O<x<1 
u(x, 0) = 0 O<x<1 


u(0, 1) = ui, N= 0 t>0 
At t= 1 compare the numerical results with the exact solution, u = cos 4at sin 27x. 


Figure 10-3 gives a program listing, and Fig. 10-4 shows two runs, one stable and one unstable. 
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PROGRAM EWAVE 

TITLE: DEMO PROGRAM FOR EXPLICIT METHOD 
FOR WAVE EQUATION, UTT = C*C*UXX 

INPUT: N, NUMBER OF X-SUBINTERVALS 
K, TIME STEP 
TMAX, MAXIMUM COMPUTATION TIME 
(X1,X2]), X-INTERVAL 
P1(T), LEFT BOUNDARY CONDITION 
P2(T),» AIGHT BOUNDARY CONDITION 
F(X), INITIAL CONDITION ON U 
G(X), INITIAL CONDITION ON UT 
E(X,T}, EXACT SOLUTION 

OUTPUT: NUMERICAL AND EXACT SOLUTION AT T=TMAX 

COMMON U(0:51),V(0:51j ,W(0:51) 

REAL K 

DATA T,X1,X2,C/0,0,1,2/ 

PI = 4*ATAN(1.] 

Pi(T) =O 

Pe[T) 0 

F(X] = SIN(2*PI*x] 

G(X} = 0 

E(X,T) = COS([4*PI*T)*SIN( 2*P1*x) 

PRINT*, ‘ENTER TMAX,NUMBER OF X-SUBINTERVALS AND TIME STEP' 


tot 


READ*, TMAX, N, K 
H = (X2-xX1)/N 
S = K/H 

Q = C*C*s*s 


SET T = 0 VALUES 
DO 10 I = 0,N 
X = X4 + IH 
w(I) = F(X) 


SET T = K VALUES 


DO 20 I = 1,N-1 
X = X1 + I¥*H 
V(I) = W{I) + K*G(X) + .5*0*(W(1+4) -2*w(I) + wlI-1}) 


v(o} = Pa(T) 
V(N) = P2(T) 
ADVANCE SOLUTION TO TIME T+K 
DO 30 I = 1,N-1 
U[I} = 2*V(I) - w{I) + O*{v(I+41]) -2*V(I) + V{I-1}) 


T=T+kK 

P1(T) 

U(N) = P2[T) 

WRITE V OVER W AND U OVER V TO PREPARE FOR NEXT TIME STEP 
= 0,N 

W(I) = v(I) 
= U(T) 

CONTINUE 

IF T IS LESS THAN TMAX, TAKE A TIME STEP 

IF[ABS({TMAX-T) ,GT.K/2) GOTO 15 

OTHERWISE, PRINT RESULT 

WRITE(6,100) 

WAXTE(6,110) N,K, TMAX 

WRITE(6,120) T 


ISTEP = .1/H 
DO 50 I = O,N,ISTEP 
X=X1 + I#H 


EXACT = E[X,T] 

WRITE(6,130) X,U(I),EXACT 
CONTINUE 
FORMAT(///,79,'RESULTS FROM PROGRAM EWAVE',/) 
FORMAT('N =',14,115,'K = ',F8.6,790,'C*G*S*S =',F5.2,/) 
FORMAT('T = ',F5.2,71B8,'NUMERICAL' ,T35, ' EXACT’ ,/) 
FORMAT( 'X = ',F4,1,1713,F13.8,130,F13.6) 
END 

Fig. 10-3 
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= 10 K = 0,700000 C*C*sS*S = 1,00 
= 1,00 NUMERICAL EXACT 

= QO, 0. 0. 

= O,1 -908,209473 0.587785 

= 0.2 1556 .156250 0.951056 

= 0,9 -1734,383179 0.951056 

= 0.4 19350 ,.902 466 0.587785 

= 4.5 -465 .308990 0.000000 

= %,8 —BS6 27 GSS —Q SOTA 
= 0.7 1566.169800 —0,957056 

= 0.8 -1818.75048B8 -0.951057 

= 0.9 1211 .699341 ~0,587785 
= 1.0 QO. —0.000000 


K = 0.010000 c*c*s*sS = 1,00 


KKK KK 4 RK KKK MMR KKK HZ 
it 
nm 
oO 


= 1,00 NUMERICAL EXACT 

= O. 0. 0. 

= Q.1 0.587232 0.587785 
= 0.2 0.950161 0.951056 
= 0.8 0.850161 0.851056 
= 0.4 0.587232 0.587785 
= @.5 0.000000 0.000000 
= O.6 -0 587232 ~0,587785 
= Q,.7 ~0.950161 —0.951 056 
= 0.8 —-0 950161 -0.951057 
= 0.9 -0 587231 -0,587785 
= 1,0 0. -0,000000 

Fig. 10-4 


10.3. Rework Problem 10.2 using the implicit method (10.3). 


See Fig. 10-5 for a program listing, and Fig. 10-6 for a (stable) run. 


PROGRAM IWAVE 


c TITLE: DEMO PROGRAM FOR IMPLICT METHOD 
c FOR UTT = C1*C1*UXXx 
c INPUT: N, NUMBER OF X-SUBINTERVALS 
C K, TIME STEP 
c TMAX, MAXIMUM COMPUTATION TIME 
c C1, CELERITY VALUE 
c (X1,X2), X-INTERVAL 
C P1(T], LEFT BOUNDARY CONDITION 
c P2(T), RIGHT BOUNDARY CONDITION 
c F(X), INITIAL CONDITION FOR U 
C G(X), INITIAL CONDITION FOR UT 
c E(X,T), EXACT SOLUTION 
c OUTPUT: NUMERICAL AND EXACT SOLUTION AT T=TMAX 
COMMON/BLOCK1/A(51) ,8(51),C(51),0(51),L 
COMMON/BLOCK2/U( 0:51) ,V(0:51) ,W(0:51) 
REAL K 
DATA T,X1yX2,C1/0,091»2/ 
PI = 4*ATAN(1.) 
Pa(t) =0 
P2(T) = 0 
F(X) = SIN(2*PI*x) 
G(x) = 
E(X,T) = COS(4*PI*T) *SIN( 2*PI*x) 
PRINT*,'ENTER TMAX,NUMBER OF X-SUBINTERVALS AND TIME STEP! 
AEAD*, TMAX,N,K 
H = (X2-x4)/N 
S = K/H 
P = C1*C1*S9*S 
c SET T = 0 VALUES 


W(I) = F(X) 
10 CONTINUE 


Fig. 10-5 (Program continues on next page) 
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SET T = K VALUES 
T=K 
DO 20 I = 1,N-1 
X = X1 + I*H 
V(I) = WEI) + K*G(X) + .5*P*(w(I+1) - 2*w(I) + w{I-1)) 
CONT INUE 
v(o} = Pi(T) 
V(N] = P2(T) 
DEFINE TRIDIAGONAL LINEAR SYSTEM 
L = N-1 
bo 30 I 
A(T) 
B(I) 
C(t) 
D(I} 
CONTINUE 
CALL TRIDIAGONAL LINEAR EQUATION SOLVER 
CALL TRIDI 
WRITE SOLUTION AT TIME T+K INTO THE U~ARRAY 


-P 
4*v(I) - 2°w(I) + P*(w(I-1) - 2*w({I) + wlI+1)) 


"otou ue a 
uy 
+ 
nm 
* 
v0 


u(O) = P1(T) 
U(N] = Pa(T) 
WRITE V OVER W AND U OVER V TO PREPARE FOR NEXT TIME STEP 


DO 50 I = O,N 
w(I) = v{I) 
V(I) = uf) 

CONTINUE 


If T IS LESS THAN TMAX, TAKE A TIME STEP 
IF(ABS(TMAX-T) .GT.K/2) GOTO 15 
OTHERWISE, PRINT RESULT 

WRITE[6,100) 

WRITE(6,110) N,K,P 

WRITE(6,120) T 


ISTEP = .4/H 
DO 60 I = 0,N, ISTEP 
X= x1 + I%H 


EXACT = E[X,T) 
WRITE([6,130) X,U{1),EXACT 
CONTINUE 
FORMAT(///,18,'RESULTS FROM PROGRAM IWAVE',/] 
FORMAT(’N =',14,1715,'K = ',F8.6,730,'C1*C1"%S*S =',F5.2,/) 
FORMAT('T = ',F5,2,118,'NUMERICAL! , aS, ' EXACT’ ,/] 
FORMAT( 'X = ',F4.1,713,F19.6,130,F13.6) 
END 
SUBROUTINE TRIDI 
COMMON/BLOCK1/A[51) ,8{51] ,C(51)},0[51},L 
TITLE: TRIDIAGONAL LINEAR EQUATION SOLVER FORA 
A SYSTEM WITH A NONZERO DETERMINANT 
INPUT: A, SUBDIAGONAL OF COEFFICIENT MATRIX 
B, DIAGONAL OF COEFFICIENT MATRIX 
C, SUPERDIAGONAL OF COEFFICIENT MATRIX 
0, RIGHT HAND SIDE OF LINEAR SYSTEM 
L, NUMBER OF LINEAR EQUATIONS 
OUTPUT: SOLUTION OF LINEAR SYSTEM STORED IN D-ARRAY 
FORWARD SUBSTITUTE TO ELIMINATE THE SUBDIAGONAL ELEMENTS 
Do 1 IT =“2,1 
AT = -A{I)/B{I-1) 
B(I) = B[I) + AT*C(I-1) 
D(I) = D{I) + AT*D{I-1} 
CONTINUE 
BACK SUBSTITUTE AND STORE THE SGLUTION IN D-AARAY 
D(L] = D(L)/B(L) 
DO 2 I = L-1,i,-1 
D(I) = (D({I) - C{1)*D(1+1))/B(T} 
CONTINUE 
RETURN 
END 


Fig. 10-5 (Continued) 
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20 K = 0.010000 c*C*S*s = 0.16 N= 20 K = 0.050000 C*C*S*S = 4,00 
1.00 NUMERICAL EXACT T= 1,00 NUMERICAL EXACT 

0. O. 0. X= 0D. 0. QO. 

0.1 0.585343 0.587785 X= 0.1 0.365416 0.587785 
0.2 0.947058 0.951056 X= ‘pe 0.591255 0.951056 
0.3 0.947057 0.951056 X= 0.3 0.591255 0.951056 
0.4 0.585313 0.597785 X= 0.4 0.365415 0.587785 
0.5 -0,000001 0.000000 X= 0.5 0.000000 0.000000 
0.6 -0,585314 —0.587785 X= 0.6 -0.365415 -0,,587785 
0.7 -0,947057 ~0,951056 X= 0.7 -0,591 254 -0,.951 056 
0.8 -0.947058 ~0,951057 X= 0.8 0.591254 -0,.951057 
0.9 ~0.585314 ~0,587785 X= 0.9 ~0.365415 -0.587785 
1.0 0. ~0,000000 X= 1.0 0. -0.000000 

Fig. 10-6 


10.4 Derive the Lax—Wendroff method (10.19). 


10.5 


A Taylor expansion in ¢ gives 
2 
U(Xa, br1) = U(Xn, G+ Ku (Xn, G+ > Un (Xn, +++ 


By (10.18), u, = —[F(u)]., and so, using a centered x-difference, 


— F(Unetj) — FUn-14) 
2h 


U(Xp, 4) a 


(1) 


(2) 


Furthermore, u,, = [F’(u) [F(4)].]x. Now, the usual centered second difference is the forward difference 


of a backward difference; that is, 
5° hn = (avi — Gn) — (bn — bn-1) 
Hence we approximate the “inside” x-derivative above as 
ew), ~ Hie) 
and represent its multiplier by a mean value: 
te F'(Unj) + F'(un-1.4) 
2 


F'(u) 


The forward differencing corresponding to the “outside” derivative then gives 
1 [ten FP" (nj) F(bnsis) — Fun) P'(Un) + na 1.5) F (uni) ~ Piot)) 
h 2 h 2 h 
Substitution of (2) and (3) in (/), and replacement of u by U, yields (10.19). 


Un(Xny 4) = 


In terms of Fig. 10-2(b), the difference equations corresponding to (10.7)-(10.11a) are 
y(P)~ y(Q) = a,[x(P) — x(Q)] 
y(P)— y(R) = A_[x(P)— x(R)] 
A,a[u,(P)— u,(Q)| + clu,(P)— u,(Q)] = fly(P)— ¥(Q)] 
A_a[u,(P)— u,(R)] + c[u,(P)— 4, (R)] = fly(P)— y(R)] 


4,(P) 
= HEP LD) (py x(Qy + HO yp) - y(Q) 


Give an iterative method for the solution of this nonlinear system. 


u(P)— u(Q) 


(3) 


(1) 
(2) 
(3) 
(4) 


(5) 
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One possibility is as follows. Calculate a first estimate, x(P'), y(P'), of x(P), y(P), by solving 


(1)~(2) with A, = A.(Q) and A_ = A_(R): 
y(R)— y(Q) + A+(Q)x(Q) ~ A-(R) x(R) 
A+(Q)— A-(R) 
A.(Q) y(R)~ A-(R) y(Q) + A+(Q)A-(R)[x(Q) — x(R)] 
A+(Q)— A-(R) 


x(P')= 


y(P')= 


(6) 


(7) 


Next, calculate a first approximation, u,(P'), u,(P'), to ux(P), uy(P), by solving (3)-(4) with A. = 


A+(Q), @=a(Q), c=c(Q), f= f(Q), y(P)= y(P'), in (3); and A-= A(R), a= a(R), c= 


f(R), y(P) = y(P’), in (4): 
c(R)B,(Q) — c(Q) BAR) 
A+(Q) a(Q)c(R)— A-(R) a(R) ¢(Q) 
A.(Q) a(Q) Bo(R) ~ A(R) a(R) Bi(Q) 
A+(Q)a(Q)c(R)— A-(R) a(R) c(Q) 
where B,(Q) = A+(Q)a(Q) uz(Q) + c(Q)u,(Q)+ f(Q)[y(P')— y(Q)] 
BAR) = A_(R) a(R) ux(R)+ c(R) u(R)+ f(R)[y(P’)— y(R)I 


ux(P') = 


u,(P') = 


Now u(P’) can be calculated from (5) as 


C7 P! x P} Q 
u(P!) = u(Q)+ BOO) (pr) — (Qy] + F¥P HO) 1y(p)- y(Q)] 
Upon the introduction of the averaged coefficients 
AL. = [As(O)+ A.(P/)V/2 Ai = [A_(R)+ A_(P’)|/2 
a’ =[a(Q)+ a(P’)|/2 G' = [a(R)+ a(P’)\/2 
& = [c(Q)+ c(P’)|/2 é = [c(R)+ c(P/)\/2 
fi =[f(Q)+ f(P’)\/2 fi =[f(R) + f(P/)V/2 


Bi = A,d’u,(Q)+ éu,(Q)+ f'[y(P’)— y(Q)] 
BY = A~ G/u,(R)+ ¢/u,(R) + fi[y(P’) — y(R)] 


successive approximations can be calculated for j = 1,2,..., as follows: 


y(R)— y(Q)+ AL x(Q)— AL x(R) 


x(P’")= ——- 
ARAL 

(prety At W(R)~ Ay y(Q)+ AL AL[x(Q)— x(R)] 
: re 7 
ux(P*!) = ci 

‘i NOE -KL BE 

(Pity = V4 a Bi- Xa Bi 

: NGO KLE 

; ~ pr 7 ; j+1 
u(P#*!) = u(Q)+— ( ye (2) (Pit) — (Qn + WE a uy(Q) 


c(R), f= 


(8) 


(9) 


(10) 


(1) 


(12) 


(13) 


(14) 


[y(P*)-y(Q)] (15) 


The iterations using (/1)—(15) are continued until two successive estimates agree to within some set 


tolerance. 


10.6 Use the numerical method of characteristics to approximate the solution to 


u — uu, =0 u(x, 0) = x u,(x, 0) = 2 


at the first characteristic grid point P between Q = (1,0) and R = (1.2, 0). 
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Using the notation of Problem 10.5, we have: 


x(Q)=1 y{Q)=0 x(R)= 1.2 y(R)=0 
u,(Q)=1 uy(Q)=2 u,(R)= 1 u,(R)=2 
u(Q)=1 u(R)= 1.2 A+(Q) = u(Q) A_(R)=—u(R) 


a(Q)=1= a(R) c(Q) = —u(OP c(R)=—u(RY f(Q)=0= f(R) 
Putting the above values in (6)-(10) of Problem 10.5, we obtain 
(PY =1.109 y(P)=0.109  wl(P)=1 wy (P')=2 ~~ u(P) = 1.3273 


Using these values to initiate the successive approximations defined by (11)-(15) of Problem 10.5, we 
obtain the values displayed in Table 10-1. (The exact solution is u= x +2y.) 


vr 


Table 10-1 


ut) 


1.10909 0.10909 2 1.32727 
1.10412 0.12116 1.34644 
1.10409 0.12212 1.34832 
1.10408 0.12221 1.34851 
1.10408 0.12221 1.34853 


1.10408 0.12221 1.34853 


Use the linear Lax—Wendroff method (10.25) (1 x 1 version) to approximate the solution to 


u,+u,=0 x>0, 1>0 
u(x, 0)=2+x x >0 
u(0, f)=2-¢ t>0 


At ¢= 0.5, for0= x =1, compare the numerical solution with the exact solution, w=2+x-t 


A program listing is given in Fig. 10-7, and the results of a stable run and an unstable run are 
displayed in Fig. 10-8. The exact agreement in the stable run is explained by noting that the analytical 
solution is linear in x and ¢ and therefore the local truncation error is zero. Thus, the only errors in the 
calculation are rounding errors. The unstable run illustrates the growth of these errors even in the 
absence of any truncation errors. 


PROGRAM LLAXW 


c TITLE: DEMO PROGRAM FOR LAX-WENDROFF METHOD 
c FOR LINEAR EQUATION UX + UT = O 
c INPUT: H, X-GRID SPACING 
c K, TIME STEP (K/H < 1 FOR STABILITY) 
c TMAX, MAXIMUM COMPUTATION TIME 
C F(X), INITIAL CONDITION ON U, U(X,0) = F[X) 
c P(T), BOUNDARY CONDITION, U[0,T} = P[T) 
C E(X,T), EXACT SOLUTION 
G OUTPUT: NUMERICAL AND EXACT SOLUTION AT T=TMAX 
COMMON U(0:500),V({0:500) 
REAL K 
F(X) = 2+X 
P(T) =2-T 
E(X,T) =24+X-T 
PRINT*, "ENTER TMAX,X-GRID SPACING AND TIME STEP’ 
READ*, TMAX, H, K 
Tso 
S = K/H 


Fig. 10-7 (Program continues on next page) 
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DEFINE SUFFICIENTLY LARGE NUMERICAL INITIAL INTERVAL 


NMAX = 1/H + TMAX/K + 1 
SET INITIAL CONDITION 
DO 10 I = G,NMAX 

xX = I*H 

V(I}) = FIX) 
CONTINUE 


ADVANCE SOLUTION TO TIME T+K AND SET BOUNDARY VALUES 


DO 30 I = 1,NMAX-1 


UL I)=V(I}-.5*S*(V[1+1)-V( 1-1} )+.5*S*S*(V(I-1)-2*V[1}+V[1+1)} 


CONTINUE 
T=T+kKk 
NMAX = NMAX -—1 
U(O) = P(T) 


WRITE U OVER V TO PREPARE FOR ANOTHER TIME STEP 


Do 40 I 
V(T} 
CONTINUE 


0, NMAX 
u(1) 


IF T IS LESS THAN TMAX, TAKE ANOTHER TIME STEP 


IF(ABS{ TMAX-T] .GT.K/2}] GOTO 15 
IF T EQUALS TMAX, PRINT RESULT 
WRITE(6,100) 

WRITE(6,110) H,K,S 
WRITE{6,120) TMAX 

ISTEP = .1/H 


IMAX = 1/H 
DO 50 I = 0, IMAX, ISTEP 
X = I*H 


EXACT = 2+X-T 
WRITE(6,130) X,U[I), EXACT 
CONTINUE 


FORMAT(///,TS,'RESULTS FROM PROGRAM LLAXW',/) 


FORMAT('H =',F5.2,115,'K = ',F5.2,730,'S =',F5.2,/) 


FORMAT('T =',F5.2, 1719, "NUMERICAL' ,735,'EXACT' ,/) 


FORMAT( 'X = ',F4,1,113,F13.6,130,F13.6) 
END 
Fig. 10-7 (Continued) 


H = 0,10 K= 0,10 s = 1.00 

T = 0,50 NUMERICAL EXACT 
X= 0. 1.500000 71,600000 
X= 0.1 1.600000 1.600000 
x= O,2 1.700000 1.700000 
X= 06.9 1.800000 1.800000 
X= 0.4 1,900000 1.900000 
X= 0,5 2.000000 2.000000 
x= Q.6 2.100001 2.100000 
X= 0.7 2.200001 2.200000 
X= O.6 2.300001 2.900000 
X= 4,9 2.400001 2.400000 
X= 1.0 2,500001 2.500000 
H = 0,02 K= 0,04 S = 2,00 

T = 0.50 NUMERICAL EXACT 
X= QO, 1.480000 1.480000 
X= Q.1 —228 278488 1.580000 
X= 0.2 1824 .329346 1.680000 
X= Q,3 -314.192566 1.780000 
X= 0.4 1201 .677366 1.880000 
X= 0.5 1047 932617 1,980000 
X= 0.6 449 .913300 2.080000 
X= 0.7 —1787 .070679 2.180000 
X= 0.8 70.098160 2.280000 
X= 4.9 1202.175171 2.980000 
X= 1.0 —1038 ,922974 2.480000 


Fig. 10-8 
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Apply Wendroff’s implicit method (10.17) to the initial-boundary value problem of Problem 
10.7 with s = 2.00, the case in which the Lax—Wendroff method proved to be unstable. 


See Figs. ]0-9 and 10-10. As expected, this stable method produces the exact solution. Notice that 
even though the difference method is implicit, the calculations in the program proceed from left to right 
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in x, in an explicit manner. 
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PROGRAM WENDI 

TITLE: DEMO PROGRAM FOR WENDROFF'S IMPLICIT 
METHOD FOR EQUATION UX + UT = 0 

INPUT: N, NUMBER OF X-SUBINTEAVALS 
K, TIME STEP (K/H < 4 FOR STABILITY) 
TMAX, MAXIMUM COMPUTATION TIME 
(X1,X2), X-INTERVAL 
F(X], INITIAL CONDITION ON U, U(X,0) = F(X) 
P(T), BOUNDARY CONDITION, U(O,T) = P(T) 
E(X,T), EXACT SOLUTION 

OUTPUT: NUMERICAL AND EXACT SOLUTION AT T=TMAX 

COMMON U(0:500),V(0:500) 


REAL K 

DATA T,X1,X2/0,0,1/ 
F(X) =2 +X 

P(t) =2-T 

E(X,T) =2+X-T 


SET TMAX AND X AND T STEP SIZES 
PRINT*,'ENTER TMAX,NUMBER OF X-SUBINTERVALS AND TIME STEP! 


READ*, TMAX,N,K 
H = (X2-X1)/N 
S = K/H 


SET INITIAL CONDITION AND BOUNDARY CONDITION 
DO 10 I = 0,N 
X = X1 + I*H 
v(I) = F(X) 
CONTINUE 
u(0) = P[K) 
ADVANCE SOLUTION TO TIME T+K AND SET SOUNDARY VALUE 
T=T+K 
u(O) = P(T) 
DO 30 I = 1,N 
U(I)=V{I-1}+(41-S}*(V(I) - Ul I-1))/(1+8) 
CONTINUE 
WRITE U OVER V TO PREPARE FOR ANOTHER TIME STEP 


DO 40 I = 0,N 
V{1) = u(T) 
CONTINUE 


IF T IS LESS THAN TMAX, TAKE ANOTHER TIME STEP 
IF([ABS[TMAX-T] .GT.K/2] GOTO 15 
IF T EQUALS TMAX, PAINT RESULT 
WAITE(6,100) 
WRITE(6,110) N,K,S 
WAITE({6,120) TMAX 
ISTEP = .1/H 
IMAX = 1/H 
DO 50 I = 0, IMAX, ISTEP 
X= X41 + ISH 
EXACT = 2+X-T 
WRITE(6,130) X,U{I},EXACT 
CONTINUE 
FORMAT(///,79,'RESULTS FROM PROGRAM WENDI',/) 
FORMAT('N =',14,115,'K = ',F5,2,T30,'S =',F5.2,/) 
FORMAT('T =',F5.2,718, NUMERICAL! , 135, 'EXACT' ,/J 
FORMAT( 'X = ',F4,1,113,F139.6,130,F13.6) 
END 


Fig. 10-9 
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N = 100 K = 0,02 S$ = 2,00 


T = 0,50 NUMERICAL EXACT 

x= O. 4.500000 4,500000 
X= 0.1 1.600000 4.600000 
X= 0.2 4.700000 1.700000 
X= 0.3 4.800000 1.800000 
X= 0.4 4.900000 4.900000 
X= 0.5 2.000000 2,0g0000 
X= 0,6 2.100000 2.100000 
X= 0,7 2.200006 2.200000 
X= 0.8 2,300000 2.300000 
X= 0.9 2.400000 2.400000 
X= 1.0 2.500000 2.500000 

Fig. 10-10 


PROGRAM CLAXW 
TITLE: DEMO PROGRAM FOR LAX-WENDORFF METHOD 
FOR CONSERVATION EQUATION (U*U/2)X+UT=0 
INPUT: H, X-GRID SPACING 
K, TIME STEP 
TMAX, MAXIMUM COMPUTATION TIME 
F(X), INITIAL CONDITION ON U, U[X,0) = F(X) 
P(T), BOUNDARY CONDITION, U[0,T) = P(T) 
E(X,T), EXACT SOLUTION 
OUTPUT: NUMERICAL AND EXACT SOLUTION AT T=TMAX 
COMMON U(0:500),V(0:500) 


REAL K 
F(X) =X 
P(T) =0 


E(X,T) = X/[{1+T] 
SET TMAX AND X AND T STEP SIZES 
PRINT*,'ENTER TMAX,X-GRID SPACING AND TIME STEP’ 


READ*, TMAX, H, K 
T=0 
S = WH 


DEFINE SUFFICIENTLY LARGE NUMERICAL INITIAL INTERVAL 
NMAX = 1/H + TMAX/K + 4 
SET INITIAL CONDITION 
DO 10 I = 0,NMAX 
X = I*H 
V(I) =x 
CONTINUE 
ADVANCE SOLUTION TO TIME T+K AND SET BOUNDARY VALUES 
DO 30 I = 1,NMAX-1 
U(I}) =V(I) — .5*S*(V(I+1)**2-V[ 1-1) **2)/2 


U{I) = U[I) + S*S*(V(14+1)+V(1) )*(V( 141 )**2-V( 1) **2)/8 
U[I) = U[I) -— S*S*(V{I)+V[ 1-1} ) *(V{1)**2-v( 1-1) **2)/8 
CONTINUE 
T=T+K 
NMAX = NMAX —1 
u{o) = 0 
WHITE U OVER V TO PREPARE FOR ANOTHER TIME STEP 
DO 40 I = O,NMAX 
V(I) = Uf[I) 
CONTINUE 


IF T IS LESS THAN TMAX, TAKE ANOTHER TIME STEP 
IF(ABS(TMAX-T) .GT.K/2) GOTO 15 
IF T EQUALS TMAX, PRINT RESULT 
WRITE(6,100) 
WRITE(6,110) H,K,S 
WRITE(6,120) TMAX 
ISTEP = .1/H 
IMAX = 1/H 
DO 50 I = 0, IMAX,ISTEP 
xX = I*H 
EXACT = X/(1 + T) 
WRITE(6,130) X,U([I),EXACT 
CONTINUE 
FORMAT(///,19,'RESULTS FROM PROGRAM CLAXW' ,/j 
FORMAT('H =',F5.2,715,'K = ',F5.2,130,'S =',F5.2,/) 
FORMAT('T =',F5.2,1718,'NUMERICAL' ,135,' EXACT‘ ,/) 
FORMAT( 'X = ',F4,1,113,F13.6,130,F13.6) 
END 
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Use the Lax—Wendroff method (/0.19) to approximate the solution of 


(u?/2), + u, = 0 x>0, t>0 \ 
u(x, 0) = x x>0 
u(O, 1) =0 t>0 


At t= 1, for 0=x <1, compare the numerical solution with the exact solution, uw = x/{1+ f). 


See Figs. 10-11 and 10-12. A “sufficiently large numerical initial interval” is one that includes the 
numerical domain of dependence of the interval on which it is desired to approximate the solution. 


H = 0.10 K = 0.10 S = 1,00 
T = 1.00 NUMERICAL EXACT 
os). Be Q. 0. 
X= 0.4 0.050146 0.050000 
X= O.2 0.100292 0.100000 
K= 0.3 0.150438 0.150000 
X= 0.4 0.200585 0.200000 
X= 0.5 0.250731 0.250000 
X= 0,6 0.300877 0.300000 
X= 0.7 0.351023 0.350000 
X= 0.8 0.401169 0.400000 
X= 0.9 0.451315 0.450000 
X= 1.0 0.501 461 0.500000 
Fig. 10-12 


10.10 Show that a necessary condition for the linear Lax—Wendroff method (10.25) to be stable is 


10.11 


that |sA|<=1 for each of the eigenvalues A of the matrix A. 
Making a von Neumann analysis (see Problem 9.5), we substitute 
Eye (65, Ebon Eel” 
in (16.25), obtaining [£4°',..., €47']7 = GE, ..., Eue]7, where 


G=I- (is sin B)A- (2s? sin? =) A? (1) 


For stability, all eigenvalues u of the amplification matrix G must satisfy |u| <1. But the eigenvalues 
of the matrix polynomial (7) are the values of the polynomial at the eigenvalues A of A: 


w= 1-(issin B)A— (2s? sin?) a? (2) 
From (2), since A is real, 


[w|? = [1 “ (257 sin? s) w+ [(s sin B)AP? 


=1-(4sint) pQ-p) (pst? (3) 


It is clear from (3) that |w/? <1 for all 8 only if0<p <1; i.e, only if |sA| <1. This condition is (it can be 
shown) also sufficient for stability. 


Use the linear Lax—Wendroff method (10.25) to approximate the solution to the initial value 


Elle] +E) = bo 


u(x,0)=sinx wu(x,0)=cos x 


At t= 0.5, for 0= x= 1, compare the numerical solution with the exact solution, 
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PROGRAM SLAXW 
TITLE: DEMO PROGRAM FOR LAX-WENDORFF METHOD i 
FOR SYSTEM OF TwO EQUATIONS, AUX + UT = 0 
INPUT: H, X-GAID SPACING 
K, TIME STEP 
TMAX, MAXIMUM COMPUTATION TIME 
FU(X} & FV(X), INITIAL CONDITION ON U & V 
Eu(X,T) & EV(X,T), EXACT U & V SOLUTIONS 
A & B, COEFFICIENT MATAIX AND ITS SQUARE 
OUTPUT: NUMERICAL AND EXACT SOLUTION AT T=TMAX 
COMMON U[0:500),V(0:500) ,UN(0:500),VN(0:500),A(2,2),B8(2,2) 
REAL K 
Fu(X] = SIN(X) 
FV[X) = COS[X] 
EU(X,T) = (6"SIN(X-3*T)-6*COS(X-3*T) )/5 
+ (6°COS(X+2*T]-SIN(X+2*T] )/5 
Ev(X,T) = (SIN(X-3*T)-COS(X-3°T) )/5 
+ (6*COS[X+2*T}]-SIN(X+2°T] J/5 
SET COEFFICIENT MATRIX AND ITS SQUARE 
DATA A(1,1),A(192) pAL2p1) pAL 2.21/46 1 9 -3/ 
DATA B(194),8(192) pB8( 291) »8(2,2)/10,-6 1 3/ 
SET TMAX AND X AND T STEP SIZES 
PRINT*,' ENTER TMAX,X-GRID SPACING AND TIME STEP! 


READ*, TMAX,H,K 
T=0 
S = K/H 


DEFINE SUFFICIENTLY LARGE NUMERICAL INITIAL INTERVAL 
NLOW = TMAX/K +4 
NHIGH = NLOW + 1/H 
NMAX = NHIGH + NLOW 
SET INITIAL CONDITION 
D0 10 I = O,NMAX 
X = (-NLOW + I)*H 
u(T) FU(X) 
V(X) Fv(X] 
CONTINUE 
ADVANCE SOLUTION TO TIME T+K 
ILOW = 4 
DO 30 I = ILOW,NMAX-1 
UN(I)=U(1)-.5*S*A(1,1) *(U(1+1)-U({1-1)} 


- ,5*S5*A(1,2)*(V(1+1]-v(I-1) } 
+ §*S*B(4,1) *(uli-1)-2*u(1)+u(1+1)})/2 
+ §*s*8{1,2)*(V(I-1)-2%v[(i)+v[i+1))/2 
VN(I)=V[I)-.5*S*A(2,1) *(U(I+1)-U(I-1)) 
- ,5*S*A[2,2}*{V{14+1}-V[I-1]) 
+ §*S*8(2,1) *(UlI-1j)-2°u(1)+uU[1+1] )/2 
+ §*S*B(2,2)*(Vv(I-1]-2*v(I}+v(1+1))/2 
CONTINUE 
T=T+K 
ILOW = ILOW + 1 
NMAX = NMAX — 1 
WRITE U OVER UN AND VN OVER V TO PREPARE FOR NEXT TIME STEP 
00 40 I = ILOW,NMAX 
uU(I) = UN(T) 
V(I) = VN(I) 
CONTINUE 


IF T 1S LESS THAN TMAX, TAKE ANOTHER TIME STEP 
IF(ABS( TMAX-T] .GT.K/2} GOTO 15 
IF T EQUALS TMAX, PRINT RESULT 
WRITE(6,100) 
WRITE(6,110) H,K,S 
WRITE(6,120) TMAX 
ISTEP = .1/H 
IMAX = 4/H + ILOW 
DO 50 I = ILOw, IMAX, ISTEP 

X = (I - ILOW}*H 

EXACTU = EU[X,T) 

EXACTV = EV(X,T) 

WRITE(6,190) X,U(I),EXACTU 

WRITE(6,140) V(I),EXACTV 
CONTINUE 
FORMAT(///,1T9,'RESULTS FROM PROGRAM SLAXW',/) 
FORMAT('H =',F5.2,715,'K = ',F7.4,130,'S =',F5.2,/) 
FORMAT('T =',F5.2,118,'NUMERICAL' , 135, 'EXACT',/) 
FORMAT( 'X = ',F4.1,713,'U=',F10.6,730,'U='",F10,6} 
FORMAT( 113, ‘'V=',F10,6,1730,‘V='»F10.6,/) 
END 


Fig. 10-13 
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u(x, t) = [6 sin (x ~ 34)— 6 cos (x — 31) — sin (x + 28) — 6 cos (x + 20)]/5 
v(x, ¢) = [sin (x — 314) — cos (x - 34)— sin (x + 21) + 6 cos (x + 20)]/5 


Since the eigenvalues of 


[CHAP. 10 


are A, = ~2, A2= 3, it follows from Problem 10.10 that the stability condition in this case is 3k/h = 1. In 
the program of Fig. 10-13, note that to obtain a numenical solution on the line Y: f= tmx, OS x <1, the 
initial interval in the finite-difference calculation must be large enough to include the numerical domain 


of dependence of ¥. Comparison of the numerical and exact solutions is made in Fig. 10-14. 


H = 


T 
X 


0.05 
0.50 


QO. 


0.1 


0.2 


0.5 


0.8 


0.7 


0.8 


0,9 


K = 0,0125 S = 0.25 


NUMERICAL 


U= -0,801758 = 
V= 0,266720 = 


= ~1,020323 = 
= 0.135308 = 


U= -1.228694 = 
= 0,002545 = 


U= -1 424768 7 
= —0,.130245 = 


U= —1 606645 l= 
= -0,261792 = 


= —1.772451 j= 
= -0,390605 = 


= —1 920546 = 


= —0.515574 = 


= ~2,049451 a 
= -0,695392 = 


U= —2,157979 L= 
= ~0.748862 = 


U= -—2,244747 = 
= —0,854849 V= 


l= -2.908186 = 
= —0,952295 = 


Fig. 10-14 


EXACT 


-6.801810 
0.266422 


—1 .020427 
0.134991 


-1 ,228847 
0.002211 


—1 .424989 
0.130592 


—1.606893 
~0,.262090 


1.772742 
-0,.390969 


~1 .920878 
—0.515941 


—2 049821 
-0.635758 


~2,.158283 
-0.749224 


~2.245180 
~-0..855203 


-2,3096 45 
-0.952687 


10.12 Use the numerical method of characteristics to estimate, at y = 0.01, 0.1, 0.2, 0.3, the solution 


to 


uu, + u, = —2u 


u(x, O)= x 


3 


on the characteristic through Q=(1, 0). Then compare the numerical results with the exact 


solution. 


In the notation of Section 10.4, we have a=u, b=1, c=—2u°, x(Q)=1, y(Q)=0. The system 


(10.27 )-(10.28 ) becomes 


which is to be solved for x(P) and u(P) corresponding to the four given values of y(P). 


[x(P) — x(Q)] ~ u[y(P) — y(Q)] = 0 
[u(P)— u(Q)] + 2u*|y(P)— y(Q)] = 0 
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From the initia! condition u(x, 0)= x, we have u(Q)= 1; so, an initial estimate x(Po), u(Po), can be 
determined by solving 


[x(Po) — 1] — u(Q)y(P) = 0 
[u(Po)— 1[ + 2u(OYy(P) = 0 


to obtain x(Po) = 1+ y(P), u(Po) = 1—2y(P). Now successive approximations can be defined by solving 


u(Q)+ u(P,-1) 


[x(P))— 1] 5 y(P)=0 
2u(OY + 2u(P.- 
[u(e)— 1+ OP Pao pa 9 
for j= 1,2,..., until two approximations agree to within a set tolerance. For a tolerance of 107°, fewer 


than 20 iterations will be required. 
By the method of Problem 5.5, the exact solution along the characteristic s = 1 is found to be 


1 
u(r, 1) =(14+4ry 7 x(r, Dee lranes 1] yo, l=r 
The numerical and exact results for x and u at y= r= 0.01, 0.1, 0.2, 0.3, are compared in Table 10-2. 


Table 10-2 


Numerical 


x(P) u(P) 


1.00990286 0.980571601 1.00990195 0.98058069 
1.09203010 0.840602064 1.09160798 0.84515425 
1,17240756 0.724075551 1.17082039 0.74535599 
1.24394498 0.626299874 1.24161985 0.67419986 


10.13, By Problem 5.12, the open-channel flow equations can be expressed in characteristic aB- 
coordinates as 


2c, + v, = S(x, v)t, (2) 
26a > Ug = ~RORD) ty (2) 
X, = A,(v, c)t, (3) 
Xp = A,(v, c) ty (4) 


where c= V gu, A,(v, c)=v0t+6 Av, c)=v-—c, and S(x%, v)= 2[S,{x)- S,(v)]. Assuming that 
c(x, 0) and v(x, 0) are prescribed, obtain a numerical solution of (/)-(4) by Hartree’s method, 
which uses a rectangular grid, (x,, 4) = (mh, jk). 


It is sufficient to show how the solution is advanced from level j to level j + 1 (Fig. 10-15). Assume c 
and v are known at the grid points on level / and let P have coordinates (xn, tj+1). The a@- and 
@-characteristics through P intersect the line t=4 at Q and R, respectively. For error control, 
k= taei- is chosen small enough to locate x(Q) and x(R) between x,-1 and x,41. 

If (1)-(4) is discretized using averages of the coefficients at 4, and tj41, there results 


2[e(P)— c(Q)] + [v(P)- v(Q)] = see k (5) 
ct 0) = 6_ mp E , (6) 


2 
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AP) ae A(Q) k 

2 

A2(P) + A(R) k 
2 


x(P)— x(Q)= (7) 


x(P)- x(R)= (8) 
where S(P)=S(x(P), v(P)), etc. (5)-(8) constitutes four nonlinear equations in the four unknowns 
x(Q), x(R), c(P), v(P); the quantities c(Q), v(Q), c(R), v(R) are evaluated by interpolation between 
the grid points on ¢ = ¢;, The system may be solved by an iterative procedure similar to the one outlined 
in Problem 10.5. 


a = const. 


- sare = const. 


Supplementary Problems 


10.14 Demonstrate the von Neumann stability of (10.17). 


10.15 (a) On a grid (xn, Ym, ) = (nh, mh, jk), derive an explicit difference equation for the wave equation 
Un — C?(Uxx + Uyy) = 0 


(b) Use the von Neumann method to derive a stability condition. 


10.16 Consider the initial value problem 


Un — 44. = 0 —wa<cy<mw, ¢>0 
u(x, 0) = cos x 0 <x <0 
u,(x, 0) = 0 -woc xy <w 


(a) Find the D’Alembert solution and evaluate it at x = 0, ¢= 0.04. (b) With hk = 0.1, k = 0.02, use (10.2) 
and the starting formula (2) of Problem 10.1 to calculate Uo2 = u(0, 0.04). (c) Repeat (5) for the (cruder) 
starting formula 


Uni = Uno = cos nh 


10.17 (a) Construct a centered-difference approximation to the damped wave equation 
Un = C7 Ug, — 2bu, (b> 0) 


(b) Make a von Neumann stability analysis of your methad. |Hint: The analysis is similar to Problem 
9.20.] (c) Show that in the limiting case c?s*=1, the method becomes the DuFort—Frankel method 
(9.19). {Hint: In Problem 9.10, set h?/k? = c? and a? = c?/2b.] 
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10.18 


10.19 


10.20 


10.21 


10.22 


10.23 


10.24 


10.25 


10.26 


(a) Solve analytically the mixed boundary value problem 


Xt, — yyy = I x>l,y>l 
u(x, 1) = log x x>1 
uy (x, 1) = 2 x>1 
u(1, y)= 2 log y youl 


[Hiint: Assume u(x, y)= X(x)+ Y(y).] (6) Determine the characteristics of the PDE. 


(a) Write out the characteristic equations (/0.7)—(10.11) for Problem 10.18. (b) Integrate the first two 
characteristic equations to obtain the first characteristic grid point, P, between Q=(2,1) and R= 
(2.1, 1). (c) Difference the remaining characteristic equations and estimate u,(P), u,(P), and u(P); 
compare these values with those furnished by the analytical solution. 


Show that to apply the method of characteristics to (10.4) in the region M: x >0, y >0, it is necessary 
that uw and u, be given on y = 0 (y is the timelike variable). Moreover, show that (i) if A, >0 and A_ <0 
in ©, then uw or u, or a linear combination of u and u, must be specified on x = 0; (ii) if A, >0 and 
A_>0, then u and u, must be specified on x = 0; (iii) if As <0 and A_ <0, then neither u nor u, can be 
specified on x = 0 independently of the values of u(x, 0) and u,(,, 0). 


(a) Verify that u = xy solves 
xe — Uy, = 0 x>0, y>2 
u(x, 2) = 2x x>0 
uy (x, 2) = x x>0 


(6) Determine the characteristics of the PDE and the location of the first characteristic grid point, P, 
between O = (1, 2) and R = (2, 2). 


Use the numerical method of characteristics to obtain the initial approximation to the solution of 
Problem 10.21 at grid point P. Compare the numerical and the exact results. 


(a) With h = 0.5 and k = 0.2, apply (10.13) to approximate the solution to u, ~ 2u, = u, u(x, 0) = cos x, at 
(x, 1) = (1, &). Compare the numerical solution with the exact solution, u = e‘ cos (x + 28). (b) Repeat 
with h =0.1 and k =0.04. 


(a) With h = 0.5 and k = 0.2, apply (/U./4) to approximate the solution to u,+ 2u, = 1, u(x, 0) = sin x, at 
(x, £)= (1, &). Compare the numerical solution with the exact solution, u = ¢+ sin (x — 24). (b) Repeat with 
h=0.1 and k = 0.04. 


With h =0.1 and &k =0.1, apply Wendroff’s implicit method (70.17) to approximate the solution to the 
initial—boundary value problem 


u,+ 2u, =1 x>0, 1>0 
u(x, 0) = sin x x>0 
u(0, 6) = t— sin 2¢ t>0 


at (x, 4) = (0.1, 0.1). Compare the numerical solution with the exact solution, w = ¢+ sin (x— 24). 


With h = 0.1 and k = 0.2, apply Wendroff’s implicit method (10.17) to approximate the solution to 


u— ue = xt x<1, ¢>0 
u(x, 0) =0 x<l 
u(,)=t t>0 


at (x, ) = (0.9, 0.2). Compare the numerical solution with the exact solution, u = xt. 
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10.27 


10.28 


10.29 


10.30 
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Use the change of variable » = e-'u to transform u, — 2u, = u, u(x, 0)=cos x to v,-2v, = 0, v(x, 0)= 
cos x. With h=0.5 and k =0.2, apply the Lax-Wendroff method (20.19), where F(v)=—2v, to ap- 
proximate v at (x, t)= (0.5, 0.2). Recover u and compare the numerical result with the exact solution 
from Problem 10.23. 


With h =0.1 and k = 0.2, apply the Lax—Wendroff method (10.19) to approximate the solution to 
—} tu,=0, u(x, 0)= 

() 0) 

at (x, t) = (0.2,0.2). Compare the numerical solution with the exact solution, u= x(1+4)"'. 


Use the numerical method of characteristics to obtain an initial approximation to the solution of 


yu, + xu, = x? + y? wc y<m, y>d 
u(x, 0)=0 —w< xy < ow 


at y = 0.3 on the characteristic through (1, 0). Show analytically that the equation of this characteristic is 
y =(x?-1) and that u= xy is the exact solution to the problem. Compare numerical and exact 
solutions. 
Use the numerical method of characteristics to estimate the solution of 

uu, — ly =x, u(x, 1I)=x-2 


at y= 1.5 on the characteristic through (2,0). Compare the numerical results with the exact solution, 
u=x-2y. 


Chapter 11 


Difference Methods for 
Elliptic Equations 


11.1 LINEAR ALGEBRAIC EQUATIONS 


In a linear elliptic boundary value problem, if all derivatives are replaced by their corresponding 
difference quotients, a system of linear algebraic equations results. 


EXAMPLE 11.1) On the square Q: 0<x<@0<y< @ consider the Dirichlet problem for Poisson’s equation, 
Urey + Uyy = F(X, y) in Q (11.1) 
u= g(x,y) on $ (11.2) 
Choosing a mesh spacing h = €/4, define on © the grid points 
(Xm> Ya) = (nh, nh) (m, n = 0, 1, 2, 3, 4) 
Using central differences to approximate u,. and u,,, one obtains the difference equation 


Umein~ 2U inn + Un-in EB; — DIE Uncass 


7s : i = fa (11.3) 


where fmn = f(Xm, Yn), and the boundary values are Ujn = 8mn for m or vn equal to 0 or 4. 

A system like (17.3) is more clearly displayed as a system of linear equations if the grid points are labeled by a 
single index. Thus, if the interior nodes are ordered left-to-right and bottom-to-top, as in Fig. 11-1, then we can write 
Uy, = Uy, Ux = U2, ..., and can reindex f similarly. With this indexing, multiplication of (11.3) by —h* produces 
the following nine linear equations in the nine unknowns U;: 


Po) et Os Sa oe. OY. OS SG a) B, 
-1 4 -1 0-1 0 0 0 Of/ & Bz 
0-1 4 OO 0O -1 0 6 Off Bs 
eh Qn MOR: Ae Sh AO EO. iO? SOHN Ba 
6 Sh OA a Sh Oe ES OC hs ee 
0 oO -1 0 -1 4 =O O -1]) Us Bs 
0 oO OO -1 0 0 4 -1 Olu B, 
0 0 OO O -1 O -1 4 ~14) Us Be 
| o0 0 O&O 0 O =) O -1 4// Us| [ae | 


where, in the case g =0, B; =—h’?f,. 
By the scheme of Example 11.1 the difference equations for the general, two-dimensional, linear, 
elliptic boundary value problem (see Problem 11.7) can be put in the form 
AU=B (11.4) 
The following remarks are pertinent to the general problem. 


(1) The dimension of the vectors U and B is equal to the number of nodes at which the solution 
is to be approximated. 


(2) The vector B is determined by the boundary conditions and the u-independent terms in the 
PDE. 


(3) The matrix A is square and contains at most five nonzero entries per row. With Q fixed, the 
order of A, given in (1) above, is a certain decreasing function of the mesh spacing h. Thus, 
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Xo xy x2 X4 X4 x 


Fig. 11-1 


even if the entries of A do not involve h, the eigenvalues of A—and those of various 
iteration matrices to be derived from A—will be functions of h. 


(4) Provided the boundary value problem has a unique solution and A is sufficiently small, A is 
nonsingular, so that the system (J1.4) has exactly one solution. 


11.2 DIRECT SOLUTION OF LINEAR EQUATIONS 


A method for solving (11.4) is called a direct method if it produces the exact solution to (11.4) 
(up to rounding errors) by a finite number of algebraic operations. Gaussian elimination is an 
example of a direct method. Direct methods are generally restricted to problems such that (77.4) can 
be accommodated in the central memory of the available computer. 

If (/1.4) is to be solved for a given nonsingular matrix A and several vectors B, the LU- 
decomposition method is more economical than Gaussian elimination. This method is based on a 
factorization of A of the form A=LU, where L is a lower-triangular matrix and U is an upper- 
triangular matrix (see Problem 11.8). 

The matrix A is usually sparse (most entries are zero), banded (some set of contiguous diagonals 
contains all the nonzero entries), symmetric, and/or block tridiagonal; efficient direct methods exploit 
any such special properties. 


11.3. ITERATIVE SOLUTION OF LINEAR EQUATIONS 


Iterative methods (or indirect methods) generate a sequence of approximations to the solution of a 
system of algebraic equations. In contrast to direct methods, they do not produce the exact solution 
to the system in a finite number of algebraic operations. Iterative methods generally require less 
computer storage and are easier to program than direct methods. 

In most linear algebra and numerical analysis literature, iterative methods are stated for a system 
of equations in single-index form; e.g., (17.4). In computational applications we shall find it easier to 
use multiple indices to identify the unknowns; single indexing will be employed only in discussions of 
the convergence of iterative methods. 

The iterative methods, which below are stated for (17./)~(/1.2), extend to the general, linear, 
elliptic boundary value problem. 

Jacobi Point Iteration 
UR Se gOS Ue 


m-l,a ma-l m+n matt 


+ FWA (11.5) 
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Gauss—Seidel Point Iteration 
k+l k+) k+l k k 
Ui, =(U eal 6 Sen a 0 +U 


m-ijan mtian marti 


Successive Overrelaxation (SOR) Point Iteration 
ok = (o> 4+ ies uk 4+ U* 


mn in-i,n mein mantl 


+F/4 


US Salt taa)Ut. <0 =2) 


Some properties of these methods, in the present application, follow. 
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(11.6) 


(11.7) 


(1) The boundary condition (11.2) is accounted for by setting U*, = g,,, at all boundary nodes, 
for k =0,1,2,.... 


(2) In all three methods the initial estimate, U 


0 
mn? 


wil] converge to the solution of the difference equations. 


G3) F 


is determined by the right-hand side of the PDE (11.1): F,,, = —h’f,,,,. 


can be chosen arbitrarily and, as k > ©, the U* 


an 


(4) If (11.1) is Laplace’s equation (f = 0), Jacobi’s method consists in successively replacing the 


U-value at a node by the average of the U-values at the four neighboring nodes. 
(5) Jacobi’s method is independent of the order in which the nodes are scanned. 


(6) The Gauss-Seidel and SOR methods are stated here for a scanning of nodes in the 
numerical order of Fig. 11-1. If the nodes are scanned in a different order, (11.6) and (11.7) 
must be modified. 


(7) The Gauss-Seidel method differs from the Jacobi method only in that new information 
about U is used as soon as it becomes available. 


(8) The SOR method takes note of the direction in which the Gauss-Seidel iterates are 
proceeding and (for w > 1) extrapolates in that direction in an effort to accelerate con- 


vergence. 


(9) In (11.7), w is called the relaxation parameter; the method is characterized as under- 
relaxation or overrelaxation according as O0<w<1 or l<w<2. With w=1, the SOR 
method reduces to the Gauss-Seidel method. 


The methods (11.5), (11.6), (11.7) are point iterative methods because they update LU one grid 
point at a time. Improved convergence rates can be obtained by using block iterative methods which 
update U at several grid points simultaneously. This improved convergence is gained at the expense 
of having to solve a system of linear equations each time a block of nodes is updated. In most block 
iterative methods the calculations are arranged so that the linear system is tridiagonal and therefore 
easy to solve. For instance, choosing as the block the horizontal line of nodes n = const., we obtain 
the following row iterative counterparts of (11.5), (11.6), (11.7): 


Jacobi Row Iteration 


k+l k+] k key k 
Oa SS (Uae Bi Oda + 0 Sea + OT yas a Fn /4 

Gauss-Seidel Row Iteration 

k+l _ k+l k+l k+l k 
Ui, ~ (Oia oh Ue ath Sais 7: U att + Fn /4 


SOR Row Iteration (or LSOR Iteration) 
Oi AO yay Dat Oi OU paint tel 


mt+ia matt 
UK) = wU + (1- w)U* (0<w <2) 


mn 


Some properties of (11.8), (11.9), (11.10) are listed below. 


(1) In Jacobi’s method (11.8) the rows can be updated in any order. 


(11.8) 


(11.9) 


(11.10) 
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(2) In the Gauss—Seide] and LSOR methods (11.9) and (11.10) the rows must be updated in the 
order n=1,2,..., or else the iteration formulas must be modified. 


(3) Equations (J1.8) and (11.9) give rise to tridiagonal systems in the row of unknowns 


UU ne UG G10) docstbaimte for U7 SOs os2)- 0G 
(4) Column iteration methods similar to (11.8), (/1.9), (11.10) are also available (see Problem 
11.24). By alternating row and column iterations a variety of ADI methods can be devised (cf. 


Section 9.4), 


11.4 CONVERGENCE OF POINT ITERATIVE METHODS 


To investigate the convergence of (11.5), (11.6), (11.7), suppose the difference equation (11.3) 
written in singly indexed form (11.4). Next, write the coefficient matrix A as A = —L+ D ~ U, where L, D, 
and U are, respectively, strictly lower triangular (zeros on the main diagonal), diagonal, and strictly upper 
triangular matrices. Assume that det (D) # 0. 


EXAMPLE 11.2 For the matrix A of Example 11.1, D is the 9x9 diagonal matrix with 4s along the main 
diagonal; L is the 9 X 9 matrix with 1s along the third subdiagonal, the pattern two Is, 0, two Is, 0, ... along the first 
subdiagonal, and zeros elsewhere; and U = L’. 


Methods (11.5), (11.6), (71.7) can be expressed in matrix form as follows: 


Jacobi Point Iteration 


U" = T,U'+C, (T, =D '\(L+ U), C, =D''B) (11.11) 
Gauss—Seidel Point Iteration 
UN =T.U+C, (Tg =(@-Ly'U, Co =(-L)y'B) (11.12) 
SOR Point Iteration 
UT=TLU+C, (T, =(D- wL) [1 - #)D+U], C, =(D- wL)'B) (11.13) 


Theorem 11.1: \n (11.71), (11.12), or (11.13), if {tu} converges to U*, then AU*=B. 
As in Section 9.3, let the spectral radius of a square matrix T be denoted p(T). 
Theorem 1[.2: The sequence {U*} defined by U**’ = TU‘ +C, with U® arbitrary, converges to a 
unique vector, U*, independent of U®, if and only if p(T) <1. 
Theorem 11.3 (Stein—Rosenberg): If, for the matrix A of (11.4), a@,=0 for i#j and a, >0, then 
exactly one of the following statements holds: 
(1) O<p(Tg)<p(T,)<1 3). p(T,)= p(T) =0 
(2) 1<p(T,)< p(T) (4) p(T,)=p(T,)=1 
Theorem 11.4: For the system AU=B if (i) a4, =0 for i¥j and a, >0, 


ji) a,2> |a,| with strict inequality for some i 
Pe i 
and (iii) a change in any component of B affects every component of U, then both 
the Jacobi and the Gauss-Seidel! point iterative methods converge (conclusion (1) or 
(3) of Theorem 11.3). 


Theorem 11.5: For the system AU = B with a,, # 0, a necessary condition for the convergence of the 
SOR point iterative method is 0< w <2. If p(T,) <1, the condition is also sufficient. 
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11.5 CONVERGENCE RATES 


Let U* represent the exact solution to AU=B and let U* represent an approximation to U* 

obtained by k applications of an iterative method 

Ue =TU'+C (11.14) 
The residual vector, R‘ = B—AU*, is a measure of the amount by which U* fails to satisfy the system 
AU=B, if U* = U*, then R“ =0. The maximum residual after k applications of (11.14) is the 
maximum of the magnitudes of the components of R*. 

The convergence rate of (11.14) is defined to be —log,, p(T), where p(T) is the spectral radius of 
the iteration matrix. For large k the reciprocal of the convergence rate is roughly the number of 
further iterations of (//.14) required to reduce the maximum residual by a factor of ten. For a square 
mesh, the asymptotic convergence rate is the dominant term in the convergence rate as the mesh 
spacing approaches zero (cf. remark (3) of Section 11.1). 

To compare the convergence rates of the three point-iterative methods, some way of relating 
p(T,), p(T), and p{T,,) is needed. This relationship is given in Theorem 11.6, which involves two 
new notions. 


Definition: Matrix A is 2-cyclic if there exists a permutation matrix P such that 
PAP’ = i : 
G D, 
where D, and D, are square diagonal matrices. 


Definition: The 2-cyclic matrix A= —L+D-—U is consistently ordered if det (—BL+ aD - B™'U) is 
independent of the scalar £. 


Theorem 11.6: \f A is 2-cyclic and consistently ordered, then the eigenvalues yw of T, and the 
eigenvalues A of T,, satisfy 


(At w~1P= Aww? (w #0, A #0) (i145) 


Since Tg = T,, when w = 1, (11.15) relates the eigenvalues of T, to the eigenvalues of both T, and T,. 


Table 11-1 


Asymptotic 
Convergence Rate Convergence Rate 


Method 


—log (cos h) h?/2 


Point Jacobi 


Point Gauss-Seidel —log (cos? h) h? 


1—sinh 


Optimal Point SOR —log —— 
1+sinA 


: cosh 
Row Jacobi —log ———— h? 
2-cosh 


2 


4 cosh 
Row Gauss-Seidel ~log (——) 2h? 
2—cosh 


1— V2 sin (h/2) ]7 
Optimal Row SOR tel an) 22h 
1+ V2sin (A/2) 
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The relationship (1/.15) can be used to find the value of the relaxation parameter, o, which maximizes 
the convergence rate (minimizes p(T,,)) for the SOR method. 


Theorem 11.7: If A is 2-cyclic and consistently ordered, 


- 2 
6 =—___.— (11.16) 


1+ V1- p(T,¥ 


When the relaxation parameter is given by (11.16) the SOR method is called optimal SOR. Table 
11-1 displays the convergence rates for the iterative methods of Section 11.3 on a square of side 7. For an 
arbitrary side & replace # in the table by mh/é. 


Solved Problems 


11.1 Determine the truncation error associated with using centered differences to approximate the 


Laplacian operator, u,, + u,,, on a rectangular grid, (x,,, y,) = (mh, nk). 


By (9.3), 
h? k? 
T.E. = — Dp Urxex (¥, Yn) — pi Byyyy (Xm, ¥) = Oh? + k?) 


provided usu. and uy, are bounded. 

If a solution to a boundary value problem for Poisson’s equation has identically zero fourth 
derivatives, €.g., u = xy, then the exact solution to the difference equation gives the exact solution to the 
boundary value problem. Such solutions are valuable when comparing different numerical methods. 


11.2 Formulate difference equations with truncation error O(h”), together with discrete boundary 
conditions, for the Neumann problem 


u,, + uy, = f(% Y) in 2 (J) 
Ou 
= Btw: SOS (2) 
on 
where 2 is the rectangle 0< x <a,0<y<b. Choose grid points (mh, nh) such that Mh = a, 
Nh = b. 
By (11.3) and Problem 11.1, (1) can be approximated with truncation error O(h7) by 
SU sign Um pat Ae a U matin U anti = as ee (3) 
in which m =0,1,...,M andn=0,1,...,N. Note the tacit assumption that f is also defined on S. 


To approximate du/dn by a centered difference requires the introduction of ghost points (open dots 
in Fig. 11-2). At those grid points on S that are not corner points, the boundary conditions are: 


U main Um-in = 24 8M (n=1,2,...,N-1) (4) 
UO mnsiey Un net = 24 &mn (m= 1,2,...,M- 1) (5) 
U-in- Ui, = 2h Bon (n =1,2,...,N-1) (6) 
On. -17> Umi = 2h Bm (m= 1,2,...,M-1) (7) 


At a corner grid point, where n is undefined, let us take as the “normal derivative’ the average of the 
two derivatives along the two outer normals to the sides meeting at the corner. This leads to the final 
four boundary conditions 
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U_iot+ Ug-1 = Uiot+ Uo t+ 4h goo 

Unm-1t+ Unteto= Umit Un-io+ 4h gmo 
Unmain + Uninet = Um-in + Umn-1+ 4h gu 
Uonsr + Un = Uon-1t+ Uin t+ 4h gon 


y 


© (Xm+1, Ya) 


xX xy xy XmM-1 XM x 


° (o] ie] fe} oO fe} 
(x2, y-1) 


Fig. 11-2 


173 


(8) 


In Problem 11.2, let M = N=2 and let g =0. (a) Write out in matrix form, AU=B, the 
difference system (3)}-(8). (b) Show that A is singular. (c) By elementary row operations (which 
do not alter the system) obtain a representation A’U = B’ with A’ symmetric. (a4) Show that 


A’U = B' can be solved (nonuniquely) only if f satisfies a consistency condition similar to 


(a) For the single-indexing indicated in Fig. 11-3. we obtain, since g =0, the representation 


J fan= J sas (=0) 


2) Os BF 0 OY HO OS “ora ka 
4-1 0 -2 0 0 0 0 || le fr 

-2 4 0 0 -2 0 0 0/| U fh 
0 0 4-2 0 -1 0 0]| Us fs 

-1 0 -I 4-1 0 -I 0}| Us |=—-A?| fs 
0 -1 0 -2 4 0 0 -1 4) Us fe 
0 0 -2 0 0 4-2 0}; Uy fr 
0 0 0 ~2 0 -1 4 -1|| Us fe 
Ge 0 40. 20r A Oe ER Ah | fo _| 
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(b) Since the entries in each row of A sum to zero, the vector C=[1,1,..., 1]? satisfies AC = 0. Thus, 


the system AU = 0 has a Solution besides the zero solution, and so the matrix A is singular. In 
consequence, the numerical Neumann problem AU = B may have no solution, or it may have an 
infinite number of solutions of the form U = U* + aC. In the latter event, U is determined at each 
grid point only up to the additive constant a. 


(c) By dividing the first, third, seventh, and ninth rows of A and B by 2, and multiplying the fifth row by 


2, we produce 
) 2 -1 
—1 4 
0 -l 
-1 0 
QO) <=2 
0 0 
0 0 
0 0 
| 0 0 

or A'U=B’. 


(d) Because A’= A’” and A’‘C = 0 (since AC = 0), we have, if a solution U exists, 


BTC = (A'U)"C = UT (A'C) = U70= 0 


ooorconre-&o 


lh 


Ornoococrdcoo 


FP OoOnNocTocoo 


aw 


-1 


Nr Or oCocCco°o 


U; 
v2 
U; 
U, 
Us 
Us 
Uv, 
Us 
U, 


—h2 


which means that the entries in the vector B’ sum to zero. But this condition is equivalent to 


if the integral is evaluated by the trapezoidal rule using the nine grid points. 


Show how to apply finite differences to 


[ f(x, y) dx dy =0 
Q 


in the case that 1 has a curved boundary. 


u,, + uy, = f(x, y) 
u= g(x, y) 


in {2 
on S 


At any grid point in {2 whose four neighboring grid points are also in the usual difference 
expressions for ux. and uy, can be used. Consider a grid point in Q with at least one neighbonng node 
not in 2; e.g., P= (%m, yn) in Fig. 11-4. The coordinates of the intermediary points q and r on S are 
respectively (%», + ah, y,) and (Xm, Ya + BA), where O< a, B <1. Since u is specified on S, u(q) and u(r) 


are known. 
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x 
Fig. 11-4 
By Taylor’s theorem, 
(ah) 7 
u(q) = u(P)+ ahu,(P)+ 5 uxx(P)+ O(h’) 
h? 
u(Q)= u(P)- ee re Uy.(P)+ O(n?) 
Eliminating u,(P) from the above pair of equations, we have 
witeye au(Q) at + a)u(P)+ u(q) | Oth) 
h?a(a t+ 1)/2 
Similarly, 
Bu(R)— (1+ B)u(P)+ u(r) 
= Oh 
Uy, (P) h?B(B ae 1/2 nm ( ) 
Thus, an O(h) approximation to Poisson’s equation at P is 
1 U U h? 
UC), UR)_ (141) yepys @) 4, UO ap) oe 
a+] Bt+l1 a B a(at+1) B(B+1) 2 


11.5 Making use of Problem 11.4, approximate the solution to 


Wel 0 xt+y'<1,y>0 
u(x, y) = 100 x+y=1,y>0 
u(xy)=0 = y=0,-1<x<1 


Choose a square grid with h = 0.5. 


Symmetry about the y-axis allows us to reduce the number of unknowns in the difference system 
from three to two: we need only consider Laplace’s equation on the quarter-disk, with boundary 
conditions as indicated in Fig. 11-5. From these boundary conditions, 


Uoo = 0 Uy = 0 Uo2 = 100 U(q) = 100 U(r) = 100 Un- U-1+1=0 


The only grid points at which u must be estimated are P = (x, y,;) and Q = (Xo, yi). 
The difference equation centered at Q is 


Uy t+ Uo2 — 4U0; + U_yyt Uoo = 0 
which, by the boundary conditions, simplifies to 
2Uo, — Ui, = 50 (1) 
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Fig. 11-5 


The coordinates of q and r are (V3h, h) and (h, V3h); hence, in the notation of Problem 11.4, 
a=Bp= V3- 1. Now, by (1) of Problem 11.4, the difference equation centered at P is 


Vor | Uo 2Uu _ U@) ; U(r) 
VS WB A/B=1. 33> 3-98 


which, in view of the boundary conditions, simplifies to 


(1— V3)Uo. + 2V3 Ui, = 200 (2) 
Solving (1 )-(2), we find 
100(2+ V3) 50(7 + V3) 
Uo. = U(Q) = 60.2 Ui, = U(P) = 70.5 
1+3V3 14+3V3 


(a) Show how to apply finite differences to Laplace’s equation in polar coordinates, 


au lou 1 au 


er =0 
or or ér =F a0" 


(b) Rework Problem 11.5 in polar coordinates, on a mesh with Ar = 0.5 and A@ = 7/4. 


(a) 


(b) 


Define the grid (7, 0.) = (m Ar, n A@), where m,n =0,1,2,..., and let U,,, be an approximation 
10 u(r, 6,). Using centered differences to approximate each derivative in Laplace’s equation, we 
obtain, after grouping like terms, 


1 1 aT 1 1 
(1-—) Une See [3 | =|] Un + (14) Umetnt A U mas = 0 
(m A6) (m A@) 2m (m A@) 
(1) 


On the polar grid, the sole unknowns are U(S)=U,, and U(Q)= U2. (See Fig. 11-5; the 
symmetry condition along the vertical axis is now u = 0, which yields the numerical condition 
Ui; = Uy.) Application of (1) of part (a), centered at S$ and ©, and substitution of boundary 
values, gives the two equations 

2[1+ (A@P] Ui — Ur2 = 150(4 YP 

—U\, + [1+ (Ab?) U2 = 75(A0Y 
These yield (A@ = 7/4): 

Uy, = U(S) = 46.3 U2 = U(Q) = 57.3 


Now, the boundary value problem under consideration can readily be solved analytically (by 
conformal mapping or by letting a >0 in Problem 7.39). The exact solution yields 
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400 1 
u(Q) = —— arctan — = 59.0 
T 2 


which shows that the coarse meshes used above and in Problem 11.5 have produced quite accurate 
results. 


11.7. (a) Formulate difference equations for 
au,, + bu,, + cu, + du, + eu = f(x, y) inQ (1) 
u= g(x,y) ons (2) 


where 1 is the rectangle 0 < x << Mh, 0< y < Nh. The coefficients are allowed to depend on x 
and y, provided a, b > 0 (elliptic PDE), and e = 0, in ©. (8) Show that if the mesh spacing A is 
chosen sufficiently small (while M and N are made correspondingly large), the system of 
difference equations has a unique solution. 


(a) With (%n, ya) = (mh, nh), 


Um- nw~ 2Uinn t Ums n m+iin  Um-in 
(Ati: )mn = mn fe BS OOS oe Siag "+ Oh?) 
Uman- 22 win Wace din nt 7 Umn- 
(Bilyy won = Bg OY Oh?) (dyn = dann — — "71. O(n?) 


These approximations, substituted in (7), yield the difference equation 


OU mn — OU pita — @2U ane — 03U main — O4U ans =~ fran (3) 
where ao = (2a + 2b — he) mn, 
ch ch 
a= (a-) as= (a+) 
Diag aoe 2S nn 
(0 “) =(o+% 
pa Wale) 7 ne A a 


Equation (3) is required to hold for m = 1,2,..., M~1,;=1,2,..., N~1.The boundary values for 
U mn are obtained from (2). 
(b) Since e <0, we have, for all m and n, 


Qo = a, + a2+ a3t ae (4) 
Also, since a > 0 and b> 0, it follows that for A sufficiently small, 
a; >0 G@=0,...,4) (5) 


Now, system (3) has a unique solution if and only if its homogeneous version, obtained by taking 
f =0 and g =0 in (1)-(2), has only the zero solution. If, contrary to what we wish to prove, the 
homogeneous (3) has a nonzero solution, we may suppose that the largest component, U,., of this 
solution is positive. Then, from (3) with f,, = 0, 


woU w= Uy. t+ QU, 1 t aU ya t+ aU poet 
which, together with (4) and U,, >0, implies 
a(U,.- U,-1,.)+ a(U,~ Up) tat(U > Uys.) t a(U we Uy.141) 59 (6) 


In view of (5), (6) can hold only if U = U,,. = max at all four neighbors of (x,, y.). Repetition of this 
argument leads to a boundary node at which U = U,, > 0, which contradicts the assumption g = 0. 
The proof is now complete. 
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11.8 (a) Show how to express an invertible matrix A of order N as the product of a lower- 
triangular matrix L and an upper-iriangular matrix U. (b) Carry out the factorization of the 
matrix A that would result if # were taken to be &/3 in Example 11.1. 


(a) The matrix factorization LU = A may be written componentwise as 


Y hme, CF=120.4N) (1) 


kok 


For L and U to be respectively lower- and upper-triangular, /;=0 for j>i and uj; =0 for j<i. 
Setting i= 7 = 1 in (7), we find /4,411 = ay; thus the diagonal elements of L and U are not uniquely 
determined. We shall choose all J; = 1. From (1) it then follows that the rows of U and the columns 
of L can be found by applying the pair of formulas 


i-l 
Ui, = ij — >, lige; G=4i1+1,...,N) (2) 
k=l 


j-) 
Ly = (aD bates) / oy (G=7+1,7+2,...,N) (3) 
k=l 


intheorderi=1,j=1,i=2,j=2,...,7=N-—1,i= N. Thesums in (2) and (3) are understood to be 
zero whenever the upper Jimit of summation is less than one. Because det (A) = [Lu,;; # 0, the right side 
of (3) is always well-defined. 


(b) The choice h = &3 produces the 4x 4 matrix 
4 -] -l 0 
-1 4 #O -l 
-l 0 4 -] 
0 -1 -!1 4 
From (2), with §= 1: a= 4, ap 1, us = -1, ua=0. 
From (3), with j= 1: hy 1/4, Isr = -1/4, la, = 0. 
From (2), with i= 2: ug = 15/4, uz = —-1/4, ua = —1. 
From (3), with j = 2: le = —1/15, la = —4/15. 
From (2), with i = 3: u33 = 56/15, usq = — 16/15. 
From (3), with j = 3: lg = —2/7. 
From (2), with i= 4: uaa = 24/7, 


Now we have obtained the desired factorization: 


1 0 o0o774 -1 -1 0 4 -1 -1 0 
1 15 4 
-~ 1 0 Ojf 0 = -- =-1 = a ae! 
4 4 4 
| 56 16 | = 
-- -— 1 0]//0 0 = -= -1 0 4 -1 
a is 15) 15 
as. 2 24 
-— -- 1/}/0 60 0 = 0 -1 -1 4 
is 9 7 


11.9 Once a system AV = B has been expressed in the form LUV = B, show how it can be solved 
for V by a forward substitution followed by a backward substitution. 


In the system LUV = B, let W= DV. Then AV = B can be written LW = B, or 


yW,=B, (i= 1,2,...,N) 


Mz 


j=1 


Since J, = 0 for i<j, we can easily solve for W as follows: 
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Wi = Billi 
W2= (Bz — by W,)/ loo 
W3= (Bs — 1h W,- be W2)/lss 


W; = (B.~ > uw)/u 
fel 


Now that W is known, the system UY = W, or 
N 
SV = 9,235.22) 
v=1 


with u, =0 for > 7, can be solved for V as follows: 


Vu = Wya/Unw 
Va = (Wri > UN-1N Ww )/Un-i.N-1 
Vn-2= (Wy-2- Un-2n Wn — UN-2.N~1 Ww-1)/u N-1N-1 


Vn-i = (Wa = S UN-~i,N-1-j Wrenncy) [reine 


j=l 


For the solution of a single linear system, the work required in an LU-decomposition is the same as 
that required in straightforward Gaussian elimination. One attractive feature of the LU-decomposition 
approach is that once L and U have been found for a given A, it is possible to solve AV = B for any and 
all right-hand sides B just by using the forward-backward substitution method outlined above. 


11.10 Write the matrix A of Example 11.1 in block tridiagonal form and obtain a block LU- 
decomposition of A, 


With 
4 -! 0 1 0 Q 0 0 0 
H= | -l 4 -1 I=/0 1 0O 0=;0 0 0 
0 -1 4 Oo 0 1 0 0 0 
we have 
H -I 0 
A=|-I H -I 
0 -I H 


By multiplying out the left side of the desired decomposition, 


I 0 0 U;, Up Us H -I 0 
Li I 0 0 Ux Us =, -I H ot | 
L3, Lz I 0 0 Us3 0 -I H 


we obtain, in succession, Uii.=H, Ui I, Up=0, La =—-H', by =0. Un =H-H', Un=~-I, 
Ly = —(H oa H")y?, Ux3 =H+ (H- Hy". 


11.11 Determine the eigenvalues and the corresponding eigenfunctions of the N x N tridiagonal 


matrix 
[b 0 | 
abe 
Cc 
abe 
LO a bl 
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If we set Up = Un+, = 0, then the eigenvalue problem AU = AU can be expressed as 


uU,-1+ (b-A)U, + cUn4, = 0 (n= 1,2,...,N) 


[CHAP. 11 


(7) 


If we look for a solution of (7) with U, proportional to r”, then (7) implies that r must satisfy the 


quadratic equation 


cP +(b-A)r+a=0 


(2) 


With m and fr, the solutions to (2), set U, =ari+ 6ri, where a and £8 are constants to be 


determined. The end conditions Up = Uns, = 0 require 
a+ B=0 and arht! + Brk"=0 
from which (r:/r2)“*' = 1, or 
FL gikntn+1) (k =1,2,...,N) 


rm 


where we have disallowed r, = r2. The product of the roots of (2) is 


a a 
n= — (= #0 assumed } 
c c 


Together, (4) and (5) yield 


ikaf(N+1) —ika/(N+1) 


n=Va/lce r2= Valce 
which, substituted in the expression for the sum of the roots of (2), 
b-x2 


Cc 


ntrrR=— 
determine the eigenvalues A, as 


Lape ae ig = 1%.) 
F +t 20 cos = 1Lo,.--, 
: cc. N+t1 : 


Note that if a and c are of like sign (the usual case), the A, are all real. 


(3) 


(4) 


(5) 


Using (6) and (3) to determine a and £, we find that the nth component of an eigenvector U* 


corresponding to Ax is given by 


a\" _ nka 
Uk = ae sin 
c N+1 


Let H be an MXM matrix with M distinct eigenvalues, A,,A,,... 
eigenvalue problem AV = yV, where A is the N X N block tridiagonal matrix 


H -I 0 
-I H -I 
-I H -I 
-I H -I 
| 0 -I 4H 


Here, 0 and I are the M X M null and identity matrices. Calculate the eigenvalues of A. 


, Ay» and consider the 


Let U* be an eigenvector of H corresponding to the eigenvalue A,. In the eigenvalue problem 


AV= yV we will look for an eigenvector V in the form 
V = [ai(U*)", a2(U*)’, ..., an (U*)"]7 


for scalars a; not all zero. From AV = yV, 
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11.13 


11.14 


a ,HU* — a2IU* = a, Uk 
— a IU* + a2HU* — a,0u* = al* 


an-1U* ake an HU‘ = an U* 


which, after using the condition HU* = A,U* (U* # 0), leads to 


Ax -4 0 a ay 
—j Ay I a2 a2 
~l AR i a3 =| & (1) 
-l1 A A] nee Qn-1 
0 —1 Ax aN an 


By Problem 11.1, the eigenvalues y; of (2) are given by 


(2) 


jk = Ay — 208 
ery N+1 


As k ranges from 1 to M and j ranges from 1 to N, (2) yields the MN eigenvalues of A. 


Find the eigenvalues of the matrix A of Example 11.1. 
Problem 11.10 gives 
H -I 0 4 -1 0 
A=;-I H -I where H=; ~-1 4 -1 
0 -I 4H QO -1 4 


By Problem 11.12, the eigenvalues of A are given by 
jw 
eS Ne 2EOS (j = 1, 2,3) 
where A,, the kth eigenvalue of H, is given by Problem 11.11 as 
ko 
RG a COS a (k = 1, 2, 3) 
Thus, the eigenvalues of A are given by 
jv ka ‘ 
ym = 4-2 (cos + cos") (, k = 1, 2, 3) 


Calculate the spectral radius, p(T,), of the Jacobi iteration matrix corresponding to the matrix 
A of Example 11.1. 


With A = —-L+D-U and T, = D''(L+U), 
AV = yV> (-L+D-U)V= yV > DV= (L+ UV+ yV> T,V=(1- yD"')V 


Since d,; = 4, D™' = (1/4)I and the last equation becomes 
Tv=(1-7)v (1) 


Now, the eigenvalues of A were found in Problem 11.13 to be 


ja ka : 
Yn = 4 2 (cos + cos —™) (j, k = 1, 2, 3) 


which, together with (Z), implies that the eigenvalues of Ty are given by 
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c + co 
Lyk Os S h > Xs 


The largest in magnitude of these eigenvalues is #1:; hence, p(T,;) = V2/2. 


For the system of Example 11.1, write the Jacobi row iteration method, (11.8), in matnix form 
and determine the speciral radius of the resulting iteration matrix, T. 


By Problem 11.10, the system can be represented as 


H -I 0] v1 c 
-I H -Ij| va |=| ca (1) 
0 -I H| v7 C7 
where v; =[U;, Ujai, Us2]" and ¢; = [B,, Bisi, Bisz]” for i= 1, 4,7. Let 
0 0 0] H 0 0 /o 1 0 
L=|1 0 0| D=, 0 H O U=| 0 01 
o | | 00H Lo 0 0 
where D is invertible (because H is invertible). Then (/) may be written 
(-L+ D-U)V=e or V=D '(L+ U)\V+D'e (2) 
where V=[v],vd, v7]7 =U and c= [e/,¢4,¢7]" =B. 
The second equation (2) is equivalent to the fixed-point iteration 
Vel= Dp (L+ UV + De (3) 
and (3) is identical to (71.8). In fact, since 
0 H™ O 
D'(L+U)=| H' 0 H’|=T (4) 
0 HH’ oO 


(3) yields 
viv} =! Ho'vé dp es 
ve (=H 'Wwttvs)t-e- 
v7 SR ve 
which is just the ‘‘solved form” of (11.8) in single-index notation. 
‘To determine the eigenvalues y of T, let w be an eigenvector of H corresponding to the eigenvalue 
Ax and Jook for eigenvectors of T of the form V=[aiw’, aaw’, apw’ |”. TV = nV implies (L+ U)V= 
uDV, or 
aw = a,ywHw = pa,a;w 
aywt aaw = agwHw = paApaaw 
a4w = a7npHw = pApanw 


Since w ~ 0, we now have 


0 L 0 ay Qa) 
1 0 1] a4 |= BA, a4 
0 1 0 


az az 


By Problem 11.11, the eigenvalues of the above tridiagonal matrix are 
ja 
BAL AOS, (j= 1, 2, 3) 


and the eigenvalues of H are 
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11.16 


ka 
ee (k = 1, 2, 3) 


Thus, the eigenvalues of the matrix T are 


cos (j77/4) 


Se cosas) Gj, k = 1, 2, 3) (5) 


Myk = 
From (5), 
V2 
4-V2 


Note that this is smaller than V2/2, the spectral radius of the point Jacobi iteration matnx for the same 
problem, as found in Problem 11.14. Equation (11.15) can be established for block tridiagonal matrices 
of the form (1). It follows that the spectral radius of the row Gauss-Seidel method for this problem is 


24- V2¥. 


AT) = e#n= 


Write a computer program which uses the SOR method (11.73) to approximate the solution to 
the boundary value problem 


Wt by = 0 inQ: O<x,y<1 
u(x, y) = e?™ sin 2ary on $ 


Choosing a mesh spacing h = 0.1, run the program at w= o@ (optimal SOR) and at w= 1 
(Gauss-Seidel method). 


Figure 11-6 lists a program. From Table 11-1, 


(T,) ath 7 
= cos — = Cos — 

a é 10 

for this problem. It follows from (11.16) that @ = 1.528 is the optimal relaxation parameter for SOR. The 

comparisons with the exact solution (u =e?” sin2zy in 2) given in Table 11-2 were obtained by 

iterating until the maximum residual was less than 0.005. Note that the Gauss-Seidel method required 67 

iterations, while SOR required only 24. For small choices of mesh spacing A, the superior convergence 


Table 11-2 


Gauss-Seidel Optimal SOR 
(K = 67) (K = 24) Exact 


1.249327 1.246912 1.101777 
2.386185 2.381623 2.065233 
3.862067 3.852746 3.341618 
4.431387 4.424993 3.871189 
7.171626 7.159750 6.263716 
7.175988 7.159992 6.263716 
8.165332 8.158091 7.250373 
13.213451 13.200061 11.741060 
13.218328 13.200035 11.741060 
8.179705 8.158471 7.256376 
15.013905 15.000215 13.601753 
24.294676 24.280386 22.008101 
24.299553 24.280504 22.008101 
15.028279 15.006590 13.601758 
0.023098 0.001065 0.000003 
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PROGRAM SOR 

TITLE: DEMO PROGRAM FOR GAUSS-SEIOEL OR 
SOR METHOD FOR POISSON'S EQUATION 
ON A RECTANGLE WITH A SQUARE GRID 

INPUT: MMAX, NUMBER OF X-SUBINTERVALS 
NMAX, NUMBER OF Y-SUBINTERVALS 
OMEGA, RELAXATION PARAMETER 
KMAX, MAXIMUM NUMBER OF ITERATIONS 
TOL, CONVERGENCE CRITERION FOR RESIOUALS 
(X1,X2), X-INTERVAL 
{¥1,Y2}, Y-INTERVAL 
Gi[X}, LOWER BOUNDARY CONDITION 
G2(Y}, RIGHT BOUNDARY CONOITION 
63(X}, UPPER BOUNDARY CONDITION 
G4(Y), LEFT BOUNDARY CONDITION 
F(X,Y), RIGHT SIDE OF POISSON'S EQ, 
E(X,Y}, EXACT SOLUTION 

OUTPUT: NUMERICAL ANO EXACT SOLUTION 

COMMON U[0251,0:51},V(0251,0251) 

OATA X1,X2,Y1,Y2/0)1 yO, 1/ 

PI = 4*ATAN(1.) 


gOnoannangnnnnannananog 


B(x) = 0 

G2(Y) = EXP(2*PI)*SIN[ 2*PI*Y} 
G3(X) = 0 

G4[Y] = SIN(2*PI*Y) 

F(X,Y] = 0 


E(X,Y) = EXP[2*PI*X) *SIN[ 2*PI*Y) 
PRINT®, ‘ENTER GRID SPACING, H, AND RELAXATION PARAMETER! 
READ®, 4, OMEGA 
PRINT®, "ENTER MAXIMUM ITERATION NUMBER, RESIOUAL TOLERANCE? 
REAO*, KMAX, TOL 
MMAX =(X2-X1]/H 
NMAX =[Y2-Y1]/H 
c SET BOUNDARY VALUES AND INITIAL ESTIMATE TO SOLUTION 
DO 10 M = 1,MMAX-1 


: 
1 eu ++ 


40 CONTINUE 
00 15 K = 1,KMAX 

c CALCULATE K-TH ITERATE 
DO 2D M = 1,MMAX~1 
00 20 N = 1,NMAX-1 


X= X41 + MPH 

Y= Y1 + NH 

UOLD = U(M,N) 

U(M,N) = (U(M+1,NJ+U(M, N41 )+U(M-1,NJ+U(M,N-1) )/4 
1 + HFHFE(X,Y]/4 


U(M,N} = OMEGA*U(M,N) + (1-OMEGA) *UOLD 


Cc CALCULATE THE MAXIMUM RESIDUAL 
RMAX = 0 
DO 30 M = 1,MMAX~1 
DO 30 N = 1,NMAX-1 
xX = X1 + M*H 
Y= Y1 + N*H 
RES=-H*H*F(X, YJ+U( M4 »N)+U{M, N41 J +U( 4-1 N)+U(M,N-1 )-4*U (M,N) 
IF(ABS(RES),GT.RMAX) RMAX = ABS(RES) 
30 CONTINUE 


Cc IF AMAX SUFFICIENTLY SMALL PRINT ANSWER 
IF(RAMAX.LT.TOL) GOTO 40 
Cc IF RMAX EXCEEDS TOLERANCE AND K < KMAX PERFORM ANOTHER ITERATION 


15 CONTINUE 
PRINT®, ‘CONVERGENCE CRITEREON WAS NOT MET! 
40 CONTINUE 
WRITE(6,100) 
WRITE(6,110) H,KMAX, TOL, OMEGA 
WAITE(G,120) Ky RMAX 
DO 50 M = 1,MMAX/2 
DO 50 N = 4, 
Xx = X1 + MPH 
Y= Y1 + N®H 
WRITE(6,130) M,N,U(M,N) ,E[X, Y] 
50 CONTINUE 
100 FORMAT(///,112,'RESULTS FROM PROGRAM SOR' ,/) ; 
410 FORMAT('H='F5.2,' KMAX=',I4," TOL=",E8.2,' OMEGA=',F6.3,/} 
120 FORMAT['K=',I4,' AMAX=’,£8,.2,T25,'NUMERICAL’ , 142, 'EXACT',/) 
190 FORMAT( 'M,N =',11,'s',s11,720,F19.6,137,F13.8] 
END 


Fig. 11-6 
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11.17 


11.18 


11.19 


11.21 


rate of the SOR method as against the Gauss-Seidel method becomes even more striking. It is seen that 
the numerical results are not in very good agreement with the analytical solution. To improve the 
numerical solution one might {i) drive the maximum residual below a smaller tolerance, or (il) use a finer 
mesh. An analysis of the truncation error (see Problem 11.1) shows it to be the villain here: to improve 
the accuracy, a finer mesh is needed. 


Supplementary Problems 


Using a rectangular grid (%n, y.) = (mh, nk), write a difference equation for the quasilinear PDE 
(aux). + (bu,)y + cu = f 


where a(x, y, u) and b(x, y, u) are positive functions. 


Let a flow field be given in 0 by q= —(aux, buy), where a(x, y, u)>0, b(x, y, u) >0. Give a numerical 
method for finding u, if the net flux across the boundary of any subregion of Q is zero. 


Let Q denote the square 0< x <1,0< y <1 and consider the boundary value problem 


(au), + (bu,)y = 0 inQ 
u= xy on S$ 


Introduce a square grid, (Xm, Ya) = (mh, nh), with A = 0.25, and center on each grid point a region 


R Bes; < seh fies < A 
mans Xm x Xm ee ore 4) eae Ps salen 
2 2 ” 2 eee 2 


Suppose that a= b=1 except in Rn, where a= b=0. (a) Using the result of Problem 11.18 and 
harmonic means for the coefhcients—e.g., 
24 m-1.n@mn 

Qm-ifn eS Sah & 

QAm-i,n F Qmn 

——write a difference system for U,, (m, n = 1, 2,3; Ux excepted). (b) Write out the Gauss-Seidel iteration 
equations (11.6) for the system of (a), assuming the nodes are scanned bottom-to-top, left-to-right. (c) Use 
the iteration equations to estimate the U,,,, and compare the values with those of the solution, u = xy, of the 
boundary value problem in which a = 6 = 1 throughout Q. 


Consider the boundary value problem defined in Fig. 11-7 (see page 186). With A = 1/3 and (Xm, ya) = 
(mh, nh), write the difference equations centered at (a) (x2, yz), (B) (xs, ys), (€) (xs, yx). (@) Obtain the 
remaining 15 difference equations and solve the system. 


Consider the system of linear equations AU = B, where 
A= [aj] U=(U,, U2,..-, Un)® B= (Bi, Bay. RY 


If a; ~ 0, show that (a) Jacobi’s point iterative method can be expressed by 


inl n 
Ut = (B- > aU} - >» ayU$) aii! (1) 


j= jEirl 


(b) the Gauss-Seidel point iterative method is given by 


n 


D ay} ai! (2) 


jzirl 


i-l 
uU* = (2 oe > ajU%"} = 
ge 


186 


11,22 


DIFFERENCE METHODS FOR ELLIPTIC EQUATIONS 


Assume that (2) of Problem 11.21 has been used to obtain the approximate solution 


k+l k+l k+) k k k\T 
(UT™, U2" ”,..., UY, UG, Ui... Ua) 


[CHAP. 
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to AU=B. The residual vector, R}*', associated with this approximation depends on both the iteration 
counter, k, and the index, #, of the first “unimproved” component. Rewrite (2) in terms of R‘*', the ith 


component of Ri*!. 


Find an expression for the SOR point iterative method like that found for the Gauss~Seidel in Problem 


11.22. 


Formulate the column iteration counterparts of (71.8) and (11.9). 


Determine the LU-factorization of 


101 
A=| 2 3 4 
19 9 
with J, = 1. 
Given the elliptic boundary value problem 
Ux + Uy + cu = f(x, y) inQ: O<x,y<3h 


u= g(x,y) on S$ 


(1) 
(2) 


where c is a constant distinct from 4, (a) write a difference equation for (1) on the grid (4m, yn) = 
(mh, nh), (b) with U=(Uy, Ua, Uz, Un)", determine the matrix T, for the Jacobi point iteration 
method; (c) find the eigenvalues of T, [Hint: solve the characteristic equation]; (d) determine the range 


of c-values for which p(T;) < 1. 
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11.27. Consider the parabolic problem 


Uy = Ux + Uyy 
u(x, y, 0) = f(x, y) 
u(x ¥, = Bly, t) 


Introduce a grid (Xm, Ya, t;) = (mh, nh, jk) and define 


w(x, y) = u(x, Y, ber) 


xyinQ,@r>0 
x ying 
x,y on S,1>0 


v(x, y) = u(x, yy tj) 


187 


(1) 
(2) 
(3) 


Verify that the result of approximating (7) at time ¢4, using centered space differences and a backward 
time difference is the elliptic system (cf. Problem 1|1.26(a)) 


(e _ 4) Wran Ht Wrntt + Wra-t.n aR Wrran-1 + Watton = eVinn 


with e =—h*/k, Conclude that Jacobi’s method or another technique of this chapter can be used to 
advance the solution of the parabolic problem from one time level to the next. 


Chapter 12 


Variational Formulation 
of Boundary Value Problems 


12.1 INTRODUCTION 


In certain cases, the solution of a boundary value problem for a PDE is also a solution of an 
associated calculus of variations problem. A typical problem in the calculus of variations is to find, 
for functions u belonging to a prescribed set #, the extreme values of the integral expression 


Suge | Pe uO Vu)do 


where F denotes a given function. Hence we shall begin by describing some of the structure of the 
domain # of J. 


12.2 THE FUNCTION SPACE L’(Q) 


In Chapter 6 we considered the space L’(a, b) of functions f(x) that are defined and square 
integrable on (a, b) in R'. More generally, let © denote a bounded region in R” and consider the set 
L*(Q) of all real-valued functions u(x) defined on 2 which satisfy 


| u(xy dX <o 
a 
Like L’(a, b), L’(Q) is a vector space over the real numbers, and the expected definition 
Gi. v= | u(x) ooapae 
a 


makes it an inner product space. 
A subset of L7(Q) is said to be a subspace of L*(Q) if the subset is closed under the operation of 
forming linear combinations. 


EXAMPLE 12.1 (a) For k a nonnegative integer, the subset C*(Q) of all uw in £7(Q) which, together with all 
derivatives of order k or less, are continuous on C2 is a subspace of L*(Q). (b) Let ui, ... 4 ux denote N elements 
of £7(Q). The subset of all linear combinations of u1,..., uw is a subspace of L7(Q)—the subspace spanned 
by the u. (c) For m a positive integer, the subset 7 (Q) of all u in L?(Q) whose derivatives of order m or 
less are also in L7(Q) is a subspace of L?(Q). 


A subspace # of L’(Q) is dense in L’(Q) if for any ¢ > 0 and any f in L?(Q) there exists a v in M 
such that 


lv-fP=| @-fra<e 
a 
i.e., if any f in L7(Q) can be approximated with arbitrary precision in the least-squares sense by a 
function from AE. 


Theorem 12.1: For each positive integer m, the following subspaces are dense in £°(): C7 (M), 
H”(Q), and the set of all wu in C"(Q) such that u=0 on S, the boundary of 9. 


Theorem 12.2: Jf M is a dense subspace in L7(Q) and if an element u of L7(Q) satisfies (u, v) = 0 for 
all v in M, then u=0. 
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12.3. THE CALCULUS OF VARIATIONS 


A real-valued function J whose domain of definition is a subset of L7(Q) will be called a 
functional. The fundamental problem of the calculus of variations is, then, to find the extreme values 
of a given functional J over a specified domain # in L’(Q). 


EXAMPLE 12.2 (a) For 2 a bounded set in R® having smooth boundary S and for given functions f in C(Q) 
and g in C(S), let #@ = {u(x, y) in H'(Q): u = g on S}. Minimize 


J[ul= ie (uz + u3 — 2fu) dx dy 


over &. (b) For 0 a bounded set in R” with smooth boundary S and for given functions aj;(x) and f(x) in C(Q), 
let A={u in H'(Q): u=0 on S$}. Minimize 


stu} = | (> ay — ou) do 


a NijHn OX; OX; 
Such problems can be treated in much the same way as extreme-value problems in elementary 
calculus, if the notion of the derivative is suitably generalized. 
Variation of a Functional 


First, we associate with the domain #& of the functional J, a set 4 of comparison functions such 
that, for any uw in & and any v in 4, u+ ev belongs to & for every real number e. . is necessarily a 
subspace of L7(Q). 


EXAMPLE 12.3 (a) For & as in Example 12.2(a), we may take # = {v in H'(Q): v =0 on S$}. (6) For @ as in 
Example 12.2(b), we may take to be identical to & In general, whenever @ is a subspace of L?(Q) and not 
Just a subset as in the first example, we may take # = (for u, v in &, the linear combination u + ev is also in 
A). 


For J a functional on domain s&, to which corresponds a set of comparison functions , let u 
belong to & and v belong to “. Then 
o(e)=Jlut ev] (12.1) 
is a real-valued function of the real variable e. 


Definition: If the limit 


$"(0) = lim Jlut+ ev]—J[u] (12.2) 


e>0 € 


exists for every v in 4 (the value of the limit will generally depend on the “direction” v), we 
write 


$'(0) = SJ[u; v] 
and call this the variation of J at u (in the direction v). 


Theorem 12.3: Let J denote a functional on domain x with associated set of comparison functions 
A, and suppose that u, in is a local extreme point for J. If J has a variation at us, 
it must vanish; i.e., 
6J[u,; v] = 0 for all v in & 


Gradient of a Functional 


Theorem 12.3 shows that the variation of a functional J is analogous to the directional derivative 
of a function on R”, which is obtained by computing the scalar product of the gradient of the function 
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with a unit vector in the given direction. Under certain conditions, we can define what is meant by 
“the gradient of a functional.” 

Consider functional J with domain #& contained in L7(Q). Suppose that the comparison functions 
comprise a dense subspace 4 of L7(Q). Finally, let D consist of all u in f such that J has a variation 
at uw and, moreover, such that there exists a G in L*(Q) having the property 


éJ[u; v] = (G, v) for all v in A 


If D is nonempty, we call the function G the gradient of J at u, and write G = VJ[u]; the subset 9 of 
x is called the domain of the gradient. 

If u, in @ furnishes a local extremum for J, Theorem 12.3 and the definition of the gradient of J 
imply that (VJ{u,], v>=0 for all v in & But M is dense in L*(Q), and so, by Theorem 12.2, 
VJ[u,] = 0. We can, in fact, prove 
Theorem 12.4: \f the subspace M of comparison functions is dense in L7(Q) and if u, in & is a local 

extreme point for J, then u, necessarily belongs to @ and 


VJ [up| = 0 
(the Euler equation for J). 

The point of Theorem 12.4 is that to solve a PDE which is the Euler equation of a suitably 
constructed functional J, subject to whatever boundary conditions are part of the definition of the 
domain @&, it is sufficient to minimize J over the class & of admissible functions. As the smoothness 
conditions incorporated into the definition of @ appear to be weaker than what is required for a 
classical solution, the solution of the variational problem is considered to be a generalized solution of 


the boundary vatue problem. In Section 12.5 we shaJl develop an even broader notion of the solution 
of a boundary value problem. 


12.4 VARIATIONAL PRINCIPLES FOR 
EIGENVALUES AND EIGENFUNCTIONS 


Consider the Sturm-Liouville problem (6.13), with C,=C,=0. Theorem 6.4 describes the 
eigenvalues and eigenfunctions of this problem. Define 
={h in H'(a, b) : 6(a) = o(b) = 0} (12.3) 


and define a functional J on , by 


[ (e@)9'@?+ ao" ax 
J[o]) =4 ; (12.4) 


| r(x)b(x) dx 


a 


It is easy to show that A, <J{] for all @ in ®; indeed, 


A, = min J[¢] (12.5) 
bey 
In addition, for k = 1,2,..., define 
b 
A, = \@ in iy: | rx)ob(x)u(x)dv=0 (7=1,2,..., ky} (12.6) 


where u,(x) denotes an eigenfunction of (6.13) corresponding to the eigenvalue A,. Then 


Ay, = min J[¢] (k = 1,2,...) (12.7) 


=F 
bet, 
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The functional (12.4) is called the Rayleigh quotient of the Sturm—Liouville problem (6.13), whose 
eigenvalues are characterized by the minimum principles (12.5) and (12.7). 
More generally, consider the elliptic boundary value problem 


—V- (p(x) Vi(x)) + g{x) u(x) = Ar(x) u(x) xing (12.8) 
u(x) =0 xons (12.9) 


where p(x)>0, g(x), and r(x) >0 are all in C'(Q). As in the case of the one-dimensional Sturm— 
Liouville problem, all eigenvalues of (12.8)-(12.9) are real and can be arranged in a countably 
infinite, increasing sequence. Moreover, weighted eigenfunctions r'*u belonging to distinct eigen- 
values are orthogonal; 1.e., 


(eu, tu, ) =| r(x) u,, (x) a, (x) dO = 0 (m #n) 
a 


The smallest eigenvalue, A,, satisfies 


A, = min J[¢] (12.10) 
GEM 
where = {¢ in H'Q): ¢=00n $} (12.11) 


and where the Rayleigh quotient is given by 


[ [ec Vo@)-Vd(e) + ge) HOR) dO 


J{o] (222) 
| r(x) b(xyY dO 
a 
Moreover, for k = 1,2,..., 
Aga, = min J[p] (12.13) 
PEM, 
where A, ={b in Ay: (rb, 'Pu)=0 (Sj <k)} (12.14) 


and u, denotes an eigenfunction belonging to the eigenvalue A,. It is readily shown (cf. Problem 
12.7(6)) that the minima in (12.10) and (12.13) are assumed at the eigenfunctions; i.e., A, = 
Jlu,] (kK =1,2,...). 

Minimum principles analogous to (12.10) and (12.13) hoid when the differential operator in 
(12.8) is replaced by a general linear, elliptic, differential operator. 


12.5 WEAK SOLUTIONS OF BOUNDARY VALUE PROBLEMS 


Let © denote a bounded region in R? with smooth boundary S$ consisting of complementary arcs 
S, and S,. Let p,q, f, 2,, 8. denote given functions which are defined and smooth on {2 and/or on S. 
Finally, define a linear partial differential operator by 


Lu(x, y) = —Vu + pu, + qu, (12.15) 
and consider the mixed boundary value problem 
Lu=f inQ (12.16) 
u= BZ, on S, (12.17) 
ou 
—= 8) on S, (12.18) 
on 


For arbitrary u and v in C*(Q), Green’s first identity, (1.7), gives 
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fe) 
(Lu, v) =| Vu-Vo dn+| (pu, + qu,)v dn- | v sas dS (12.19) 
: n a s on 

Now define 

 ={u in H'(Q): u=g,on S} 

M = {v in HQ): v=00n S$} (12.20) 
and note that for uw in » and v in A, 

u 
| v—--dS= | v— aS 
5 on S 71 


Moreover, if u in & satisfies (12./8), 


fe) 
| »Sas- vg, dS forall v in M 
S aon S 


Thus, if wu is a classical solution of the boundary value problem (12.16)-(12.18), u must satisfy 


K[u, vo] = Fle] for all v in (12.21) 
where, for u in & and v in MM, 
K[u, j=] Vu Vodn+ | (pu, + qu,)o dO (12.22) 
a rn 
Flo] =| fo? a+ | gv dS (12.23) 
a Sy 


Definition: A weak solution of (12.16)-(12.18) is any function u(x, y) that belongs to sf and 
satisfies (12.27). 


A notion of weak solution has already been encountered in Problem 5.15. Evidently, every 
classical solution of the boundary value problem is a weak solution. However, a weak solution u 
need not be a classical solution: it need only be sufficiently regular to allow definition of K|u, vj for 
all v in 4. 

In the special (self-adjoint) case that p and q in (12.15) vanish on © |i.e., when (/2.16) is Poisson’s 
equation], then 

Ku, vo] = Klo, uv] for all u, v in 


K[u, u] 20 for all u in (12.24) 
Whenever (12.24) holds, it follows that for u in & v in M, 
2({K|u, v] — Flv]}= lu; v] (12.25) 
where 
J(u] = Kl[yu, u]-—2F lu] (12.26) 


If uy is a weak solution of ihe boundary value problem (for Poisson’s equation), it follows from 
(12.25) that uy is a stationary point for J. In fact, it can be shown that uy minimizes J over xf, which 
leads to 


Theorem 12.5: Let K[u, v] satisfy (2.24) and let J[u] be given by (12.26). Then u, minimizes J 
over & if and only if K[u,), v] = Flv] for all v in #4. 


According to Theorem 12.5, the weak formulation of a boundary value problem is, provided 
(12.24) holds, the same thing as the variational formulation guaranteed by Theorem 12.4. However, 
when (12.24) does not hold, only the weak formulation is possible. Thus, the notion of a weak 
solution to a boundary value problem is more comprehensive than that of a variational solution, 
which in turn is more Comprehensive than the notion of a classical] solution. 
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Solved Problems 


12.1. Let denote a bounded region in R? with smooth boundary S. For # = 4 = H'(Q), let the 
following functionals be defined on so: 


Ju] = | (ue + uy, — 2fu) dx dy 
n 

Ju) =| (ul + ui, — 2fu) dx dy+ | pu’ dS 
xe] Ss 


sul = | (ua Fu = 2 fu) dx dy + | (pu? — 2gu) dS 
a s 


Here p and g are in C(Q) and f is in L?(Q). Compute 6J[u; v] for each functional. 


It suffices to calculate 5J3[u; v]; setting p = g =0 or g = O will yield the other two variations. For u, v 
in & and arbitrary real e, we have 


b3(€) = Jalu + ev} 


= Jz[u] + 2 i (uv, + Uyv, — fo) dx dy + 2€ | (puv — gv) dS 
a s 
+e| (vi-+ 03) drdy +e? | pu’ dS 
a s 


and so 


b3[u; v] = 63(0) = a (uyvy + uyv, — fo) dx dy + 2 I (pu-— g)vdsS (1) 


12.2 Let © denote a bounded region in R" with smooth boundary S. On of = 4 = H'(Q) define the 
functional 


By du du 
Jul = | S; a,,(x) — — + c(x)u? — 2f(x)u | dQ 
whier Ox, Ox, 
t i 7 
where the functions a, = a,, (see Section 2.1), c, and f are all in C[Q]. Find 85J,[x; v]. 
For u, v in of and arbitrary real «, 


dae) = Ja(u + €v) 


S du dv du dv ; - ak dv dv 
= J4(u) + € >, Gj (= = +2) + 2cuv — 2fo | dite | [= Qi co" | dQ 
a OX; OX; OX; OX a Ax, OX; 
Hence, from the symmetry of the ai, 
. dud 
554[ uu; v] = 640) = 2 [> ij es ae (cu ~ po| df) 
a OX; Ox; 
12.3. Let 2 denote a bounded region in R? with smooth boundary S. With 

wf ={uin H'\(Q):u=g on S} M = fv in H'(Q): v=00n S} 


and f, g in C{Q], consider the functional 
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Ju] =| (u2 + i 2fu) dx dy (u in &) 
a 


Find 9, and VJ,[u]. Note that # is dense in L7(Q). 
Problem 12.1 gives (for any # and ) 
SJilu; v] = 2] (u,v, + uv, — fo) dx dy (1) 
r 


Green’s first identity, (7.7), implies 
ou 
| (ued, + uyp,) dx dy = [ vas | v Vu dx dy (2) 
a s on a 
Since v = 0 on S for v in A, (2) used in (7) leads to 
6J,[u; v] = -2{ (Vu + f)v dx dy =(G, v) 
no 


where G(x, y) = -2[Wu(x, y)+ f(y] Gy) ind 
If V7u is in L7(Q), then G belongs to L7(Q) and we conclude that 
VJ,[u] = G = -2(V7u + f) 


for u belonging to 2, = {u in H7(Q) : u= g on S}, where H7(Q) denotes the class of functions for which 
V’u belongs to L7(Q). (A more precise characterization of the domain @ of the gradient of a functional 
can be given in the context of functional analysis.) 


For each functional of Problem 12.1, find @ and VJ[ul]. 


Again it suffices to treat J; and then to specialize the results to the other two functionals. Applying 
(2) of Problem 12.3 to (1) of Problem 12.1, we obtain 


ou 
abs{u; o) =2{ (+ pu-g) vas-2[ (Vu + f)vdx dy (1) 
s \on a 
Thus, if u in & satisfies the additional conditions 
' Ou 
(i) u belongs to A7(Q) (ii) et pu=g ons (2) 
n 


(1) shows that VJ3[u] = —2(V*u + f) on the domain Qs; defined by (2). (VJs is in L*(Q) because of (2)(i).) 
The functional J; is seen to be the energy integral for Poisson’s equation with an inhomogeneous 
mixed boundary condition: ; 
-Wu =f inQ 


ou 
——+ pu=e ons 
on 


Setting p= g=0, we see that J, the energy integral for Poissan’s equation with a homogeneous 
Neumann condition, has gradient 


é 
VJ,[u] = -2(V7u + f) for u in Qy= fu in H7(Q): = =Oon s} 
n 


In Problem 12.3, a different domain so for J; produced a different domain &; for VJ;. 


Let denote a bounded region in R* with smooth boundary S. Let S, denote a connected 
subset of S and let S, denote the complement of S, in S. Let p, f, g,, g, be functions in C(). If 


af ={uin H'(Q): u=g, on S,} AM = {v in H'(Q): v =00n $}} (0) 
find 9 and VJ for the functionals 
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J [ul = i (ur + uy — 2fu) dx dy 
ry 


J,[u] =| (ue + uy — 2fu) dx dy + | pu’ dS 
Q S2 


sul = | (u2+ u2— 2fu) dx dy + | (pu? —2g,u) dS 
0 . 


This problem illustrates further the relation between # and Q. Note that the admissible class w of 
(0) is “‘between”’ the classes of of Problems 12.3 and 12.4, in the sense that 


{u in H*(Q):u=g on S}C{u in H'(Q): u=g on S.C S}C {u in H'(O)} 


As usual, we may restrict attention initially to J3. Since v =0 on S;, we have, analogous to (/) of 
Problem 12.4, 


ou 
ahs{u; v]=2 [| (“+ pu-g2) vas—2 | (V7u + f)vo dx dy (1) 
7] on a 
We conclude that if u in & satisfies the additional conditions 
: 2 . Ou 
(i) u belongs to H’(O) (ii) or. pu=g2 on S, (2) 
in 
then VJ3[u] = —2(V7u + f) on the domain 
: ou 
Ds= {¥ in H7(Q): u= g, on Sty PER on s} 
in 
Now setting g2=0 and g2.= p = 0, respectively, we obtain: 


é 
VJo[u] = -2(Vu + f) on Do= {4 in H7(Q): u = g, on Sie pu=O0on s:} 


; ou 
Vi,[u] = -2(V7u+ f) on Q,= {¥ in H7(Q): w= g, on Se 0 on s:} 

In the case of each functional, the definition (0) of & specifies how u is to behave over the part S; 
of the boundary. Then the definition of M imposes a condition over the remainder of the boundary; this 
condition involves the normal derivative of u. Boundary conditions incorporated in the definition of sf 
are called stable boundary conditions; those included in the definition of @ are called natural boundary 
conditions. 


Let © denote a bounded region in R’ with smooth boundary S. Let f, g, and p be functions in 
C(Q). Consider Poisson’s equation 


-Vu(x, y)= f(x, y) in QO (1) 


and the Dirichlet, Neumann, and mixed boundary conditions 


“= 2 on S$ (2) 
re) 
acne ons (3) 
on 
Q 
“tpu=g on S$ (4) 
on 


Give variational formulations of the problems (1 )-(2), (/)-(3), and (1)-(4). 


All three boundary value problems are covered by the functional Js[u] of Problem 12.5, with »¢ and 
M as given in (0) of that problem. 
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(i) In Problem 12.5, take S, = S, g:= g. Then, by Theorem 12.4, if up minimizes 
(uz + u2 — 2fu) dx dy over {u in H*(Q): w= g on S$} 
a 


Up solves (1)—(2). 
(ii) In Problem 12.5, take S.= S, p=0, gz= g. Then, by Theorem 12.4, if uo minimizes 


[ tu -2fu) de dy -2] gudS — over H'\(Q) 
a s 


Up solves (1 )—(3). 
(iii) In Problem 12.5, take S2.= S, g2= g. Then, by Theorem 12.4, if up minimizes 


| (ud + w5 — 2fu) de dy + | (pu?—2gu)dS over H'(Q) 
a s 


Up solves (1)—(4). 


It is seen from (i) that the Dirichlet condition (2) is a stable boundary condition for the 
corresponding variational problem, whereas the Neumann condition (3) and the mixed condition (4) 
figure as natural boundary conditions. 


Consider the boundary value problem 
-Wu+qu= aru inQ (1) 
u=0 on S$ (2) 
with q2=0 and r>0 in N. Let A,<A,=S--- denote the eigenvalues of (1)-(2) arranged in 
increasing order, and let u, denote the eigenfunction corresponding to A,. With J[@] as given 


by (12.12), with p = 1, and &, as given by (12.11), prove: (a) if @, minimizes J over @, then 
os satisfies (1)-(2) with A = J[@«]; (b) for n =1,2,...,A, = J[u,]; (c) A, = min J[ A). 
Raf 


0 


(a) On Hh =M={¢ in H'(Q): d =0 on S} define 
Nol={ (Vp-Ved + gh?) dO D{[¢| =| rp” dQ (3) 
Then, for J[¢] = N[¢]/D[¢], 


aso; v) ~ NP: #1 DIdI- NIA] 3014: 0] Z 


Dio)’ 
lf }, in ao minimizes J, then SJ[@,; v] = 0, or 
5N[¢,; ve] — J[¢,] SDI ¢,; v] =0 for all v in Af (5) 
But, since 
BN[o; »] = 2 | (Vd -Vut qbv) dN sD[o; v} =2 | rov dQ 
a 2 

(5) implies 

| (Vb, -Vut+qb,v-A,b,v)dQ=0 for all v in A (6) 

2 


where A, =J[¢,]; or, by (1.7) and the boundary condition on », 
(-W, + 4b, —A,rb,,v)=0 for all v in # (7) 


Theorem 12.4 guarantees that the minimizing element ¢, is such as to render 
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12.8 


Vid,]=-Vb,+9b,-A,rd, 
an element of L7(Q); thus ¢, must belong to the subspace 
D={o in H7(Q):¢=0 on S$} 
of Jo. Indeed, VJ[@,] must be the zero element of L7(Q), so that $, in @ solves (1)-(2) with 


LK 
(b) Tf u, satisfies (7)-(2) with A = A,, then multiplying (7) by u, and integrating over 2 leads to 
| (—V? un + Gly — AnTUn Un, dD = 0 
n 
But, by Green’s first identity and the boundary condition, 
| (-V?un un dQ = i Vu, : Vu, dn 
n n 
Hence, 
| (Vu, °Vun + qui, —A,ru2,) dX =0 or An = J[ un) 
n 


(c) Since @, minimizes J[@] over So and since each u, belongs to %o, we have, by (b), 
A, =J[¢,]SJlula=a, (2 =1,2,...) 


But A, is itself an eigenvalue, and so A, = A,. We have just proved Rayleigh’s principle: the 
smallest eigenvalue of the boundary value problem (7 )—(2) is identical to the smallest value of the 
functional J[@]. (Cf. Problem 9.8.) 


Consider the Sturm-Liouville problem (12.8)-(12.9) and let $,,...,6,_, denote any N-1 
elements of &,, as defined in (12.11). Let D,_, denote the following subspace of x: 
QD, ..={u in Ay: ¢r'? 9 r’uy=0 (J=1,...,N—-1)} (U) 


For the Rayleigh quotient J of (12.12), write 


Cd, ---, dv.)= min J[u] (2) 
u€Dy_| 
Prove that C[¢,,..., dy_,] S Ay, with equality if $,,..., dy_, coincide with eigenfunctions of 
the Sturm-Liouville problem, corresponding to the first N—1 eigenvalues. This result, the 
Courant minimax principle, implies that A,, the Nth eigenvalue of the Sturm—Liouville 
problem, can be characterized as the maximum over all subsets {@,,..., @y_,} Of @, of the 
minimum of J[u] on Dy_,. 


To establish the desired inequality it will suffice to construct a function w in @x_-; such that 
J{w] An. Write 


N 
w= >) u(x) (3) 
i= 
where u,(x),..., Uv(x) denote the eigenfunctions associated with Ay,...,An. w will belong to Qn-1 
provided 
N 
ORG dy POW) = DOr ger as Pp HL Qaey NOD) (4) 
i=t 
As (4) constitutes a system of N—1 linear equations in the N unknowns c1,..., cn, there will always 


exist a nontrivial solution (é1,..., év). [w =0 certainly belongs to Dy-1, but J[0] is undefined.] Now 
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Lo 66, Vui(x)* Vu,(x)+ 9(x) (= éui(x)) | a0 & 966 
Itw)= a ijel . . i=l = — 
i [roo (> éui(x)) dQ 3 Be? 
2 ie i=] 
where 
6: =| L p(x) Vi (x) Vay (x) + g(x)ui(x)uj(x)] dO Bi =| r(x)u (xP dQ 
a 2 


and where we have used the weighted orthogonality of the eigenfunctions in evaluating the denominator. 
From Green’s first identity and the fact that u;(x) is an eigenfunction of (12.8)-(12.9), we can show that 


Therefore 


(5) 


where «; =0, «+ K2+---+ «Kn = 1. Thus, as a convex combination of the Aj, 
A\= Ji w] = AN 


The proof is completed by noting that, if =u, (j=1,2,...,N-1), un will belong to Dy_,= 


Mn. We then have, using (12.13), 


Clui,.-.,4v-1]= min J[u] = An 


ue sin} 


Let p*, q*, r* denote an alternate set of coefficient functions for the Sturm-—Liouville problem 
(12.8)-(12.9); these are supposed to obey the same continuity and positivity conditions as do 
P,q,r. Let the alternate and original problems have Rayleigh quotients J*[@] and J[@], and 
eigenvalues {A*} and {A,}. Show that if 


Jl@]=J*[6] for all @ in (1) 
then A,=A* (n=1,2,...). 
Inequality (/) implies that 
Cléi---, dn-i] = C*[ bi, ---, dn-i] 
If, then, g,-.., Wv-1 is a set of functions in @ that maximizes C[di,..., @w-1] and if wt,..., BAe: in 
My maximizes C*[d,,..., dx-i], the Courant minimax principle implies 


An = Cl...) Wor] = C* 6. Wii] S C* LT, WR] = AN 


For the one-dimensional Sturm—Liouville problem of Section 12.4, write p, > 0, q,, andr, >0 
for the minimum values of the coefficient functions on [a,b], and py, gy > 0, and r,, for the 
maximum values. Establish the following bounds for the eigenvalues: 


2 2: 
ny (AT) Pay xin, (| ox (eas OP a 
b : b-a/’ r 


™ —a yt m 


(1) 


The Rayleigh quotient (/2.4) clearly satisfies, for all @ in @o, 
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pu | “piaetas i (x) de 


a 


J{é|s =J*[o| 


In [ b(x¥ dx 


Now, J*[@] is the Rayleigh quotient for the Sturm—Liouville problem 


— paw" (x) + gurw (x) = A*rmw(x) a<x<b 


w(a)= w(b)=0 
which has eigenvalues 
2; 
AT 
ane Bs ( Ve (n=1,2,...) 
In b-a/’ tn 


Therefore, by Problem 12.9, A, SA%, which is the upper bound asserted in (7). The lower bound is 
established similarly, from the inequality 


b ’ 
pm | BP dx + an | b(xP dx 


Nol . 
- | (x)? de 


12.11 Let Q denote a bounded region in R* with smooth boundary S composed of complementary 
arcs S, and S,. Let p,q, 7, f, 8), 8, and h denote given functions defined and smooth on Q; in 
addition, suppose p>O on Q. Give the weak formulation of the mixed boundary value 


problem 
-V-(pVu)+ qu, + ru, = f on QD (1) 
u= on S, (2) 
é 
hie, on S, (3) 
on 


(Unless g and r vanish on Q, this problem does not admit a variational formulation.) 


For arbitrary u, v in C°(Q) we can use (1.7) to show that 


ou 
(-V-(pVu), v=] (Vu -Voypan- | v—pds 
a Ss on 
Then, if u satisfies (7), 


ou 
i (Vu-Vo)p an+ | (qu. +ru,)oar~ | v — pdS— [ fodi=0 (4) 
a a Ss on Ja 
for all v in H*(Q). 
Define 
#@ ={u in H'(Q): u= gon Sy} AM ={o in H'(Q): v =00n Sy} 
If u in & satisfies (7 )~(3), then, for every v in M, (4) gives 
K[, v] = Flv] (5) 
where K[u, v] =| (Vu -Vo)p dQ +] (qu, + ru,)v dQ+ | phuv dS 
oa n A) 
Flo] = | foan+ | pg2v dS (6) 
a s2 


The weak formulation of (1)-(3) is, therefore, to find a u in & that satisfies (5) for every v in Ud. 
The weak formulations of PDE (1) plus a Dirichtet or a Neumann condition on S are obtained, 
respectively, by taking S, = S and taking S,= S and h = 0, in the above formulation. 
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Supplementary Problems 


12.12 Let Q={(x%, y): x? + y? <1} and @ ={u in HQ): w= x? on x7 + y?= 1). For 
J[u] = (y?2u2 + x7u2) dQ (u in sf) 
a 

define M and find 8J[u; v]. 
12.13. Find 9 and VJ[u] in Problem 12.12. 
12.14 Let 2 be as in Problem 12.12. If u in sf = H'(Q) minimizes the functional 

J[u] = | (y2u2 + x7u2— 2Fu) dQ 
a 

over x, where F is in L*(Q), what boundary value problem does u(x, y) solve? 

12.15 Suppose that M is a bounded region in R? with smooth boundary S. Let F belong to L?(Q) and let 


6 
i= {win HQ): u=“=00n s} 
on 


J[u] =| [(V*u)* — 2Fu] dQ for u in Sf; 
re 
Define # and find &J[u; v]. 
12.46 Find @ and VJ[u] in Problem 12.15. 
12.17 Repeat Problem 12.16 if s¢; in Problem 12.15 is replaced by x, = H7(Q). 
12.18 With Q, ,, and J[u] as in Problem 12.15, define on s, the functional 
Stu] = i [(V7u)y? -— 2(uzcttyy — 2u2,) — 2Ful] dO 
n 


Verify that VJ[u] = VJ[u], on the domain 9 = 9. 


12.19 Let Q denote a bounded region in R* with smooth boundary S composed of complementary arcs S;, Sz, 
and $3. Give a variational formulation of the following boundary value problem: 


—-Wu=F inQ 
u= Br on Ay 


Ou 

on 389 on S2 
ou 
— + pu = g3 on S3 
on 


12.20 Let J[@] be given by (12.4) and let (a2) slo= H'(a,b), (b) o={h in H'(a, b): (a) = 0}. Show that 
if u* minimizes J over @o, then u™ is an eigenfunction of (6.13) with (a) Cy =C3=0,(b) C,=C,=0. 


12.21. Consider 
{ (pVo 7 Vo at qe’) dQ+ i ap? dS 
I{o]=— . on sy = H(Q) 
| rp? dQ 


n 
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12.23 


Here, functions p, g, and r obey the usual conditions; function @ is in cKO) and is nonnegative on S. 
Prove: (a) If u, minimizes J over %o, then u,, satisfies 


~V-(pVu)t+ qu= Aru inQ (1) 
fe) 
“tau=0 ons (2) 
on 


with A=A,=J[u,]; ie.. u, = 41, an eigenfunction of (1)~(2) belonging to the smallest eigenvalue. 
(6) An=Jlun] (n= 1,2,...). 


For the one-dimensional Sturm—Liouville problem of Section 12.4, infer from Problem 12.10 that (a) if 
Gm <0, at most finitely many eigenvalues are negative; (b) if g. 20, all eigenvalues are positive; (c) 


S, aj! converges. 
n=l 


Give weak formulations of the problems 


(a) Ug — Uyy + Qu, = 1 inQ: x,y>0, xt+y<2 
u=0 on S$ 
(6) Urge — Uyy + Quy = 1 nQs x y>0, xt+y<2 


u,(0, y)=2-y O<y<2 
uy (x, 0) = x(2~ x) O0<x<2 
u(x, 2—x)=0 O<x<2 


Chapter 13 


Variational Approximation Methods 


This chapter presents some techniques for constructing approximate solutions to boundary value 
problems. These techniques are based on the ideas of Chapter 12 and differ markedly from the 
finite-difference methods of Chapters 9, 10, and 11. 


13.1 THE RAYLEIGH-RITZ PROCEDURE 


This approximation procedure is limited to boundary value problems admitting the variational 
formulation ‘Find u* in so such that functional J[u] is minimized over @ by u*.” It was seen in 
Chapter 12 that such boundary value problems arise in connection with self-adjoint elliptic PDEs. 

We suppose # to be some subset of L7(Q), where Q denotes a bounded set in R” with smooth 
boundary S consisting of complementary portions S, and S,. Specifically, we take #= 
{u in H'(Q): u=g on S,} for a given g in C(Q); the associated subspace of comparison functions is 
taken as & = {v in H'(Q): v =0 on S}. 

Let ¢, denote an arbitrary function from #& (e.g., 6, = g) and let ¢,,..., dy denote N linearly 
independent functions in A. Then, 


Uy (x) = box) + D 6b; (%) (13.1) 


belongs to # for all choices of the constants c,,..., Cy; we denote by &,, the subset of sf consisting 
of all such functions u,. Let ux, denote the function in x, that minimizes J over #,. Jt can be shown 
that ux represents the best approximation, in the least-squares sense, from , to the exact solution 
u*, This function ux is called the Rayleigh—Ritz approximation to the solution of the boundary value 
problem. 

The minimization of J over sé, is tantamount to the minimization over all ¢ in R” of the ordinary 
function 


N 
TE Gis tay ee [to+ > “6, | 
j=l 


The minimizing constants cf, cl,..., Cy must satisfy 
ot 
Sy wcaeewewl =O (m =1,...,N) (13.2) 


which is a system of N equations in N unknowns. 

The Rayleigh—Ritz procedure may also be applied to eigenvalue problems of the sort treated in 
Section 12.4. In any eigenvalue problem the boundary conditions are all homogeneous. Hence, we 
take ¢, =0 in (13.1) and minimize the Rayleigh quotient J over the subspace @, = My. 


13.2 THE GALERKIN PROCEDURE 


This approximation method is employed when the boundary value problem admits only a weak 
formulation; e.g., in the case of a linear elliptic PDE containing odd-order derivatives. In the event 
that conditions (12.24) hold in the weak formulation, so that a variational formulation also exists, it 
can be shown (see Problem 13.4(b)) that the Galerkin and Rayleigh—Ritz procedures coincide. 

Consider, then, a boundary value problem with the weak formulation ‘Find u* in so such that 
K[u*, v] = F[o] for all v in M.” Here we suppose that 0, S, %, and M are as described in Section 
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13.1. Let $,,..-,@, denote N linearly independent éial functions in M and let ¢, denote an 
arbitrary function in &. As in the Rayleigh—-Ritz procedure, we seek an approximation u> to the 
weak solution u* of the form (13.1). In addition, let y,,...,%, denote N linearly independent 


weight functions in M; these may or may not be the same as the trial functions. The Galerkin 
approximate solution is required to satisfy 


Kut, %1= Fly) G=1...,N) (13.3) 


This is a set of N equations in the N unknowns c},..., ¢y. 


13.1 


Solved Problems 


Let © denote a bounded region in R” having smooth boundary S consisting of complementary 
pieces S, and $,. For the boundary value problem 


—V-(p(x)Vu)t+ q(x)u= f(x) in Q (1) 
u = g(x) on S, (2) 

ou 
— = g,(x) on S, (3) 

on 


where, as usual, p(x)>0 and g(x)=0 in Q, explicitly describe the construction of the 
Rayleigh—Ritz approximate solution. 


The methods of Chapter 12 lead to the following variational formulation of (1}(2)}(3): Find u* 


in o minimizing J over sf, where 


4 ={u in HO): u= gon $j} 


J[u] =| (pVu-Vu+ qu?) dQ - 2F[u) 


Flu) = | fu ans gauds 
a 


M = {v in H'(O): v =00n Sy} 


Let di,...,¢n denote N linearly independent functions from . The Rayleigh-Ritz approximate 
solution is of the form 


N 


un = >, Ci; (4) 


i=0 
where ¢o denotes an arbitrary function from @ and co= 1. We then have 


H(c,..-,¢n~) =J [un] 


N N N 
Si E D Vd; -Voadejce+q > dibicyee | dQ.- 2%) oF #7] 
rey nk=0 jk=0 720 
in which the linearity of F[ ] has been recognized. For m = 1,2,...,N, 
dH a a 
<== | [27d bm Vora +24 > dndacs | dO ~2F[bn] 
On a k=0 k=0 


N 
=2 [> Ansce ~ Fr 
kal 


where, for l= m,k=N, 
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An = | (DV bm * Vou + Gbmbu) dO Fn = Fibnl— [ (PV bm -Vbo+t dbmpo) dO 
a a 


For un to minimize J over @y it is necessary (and, H being a convex function, sufficient) that 


N 
> AmkCk _ F,, (5) 
k=l 
The solution ci,..., cX of (9) produces the Rayleigh—-Ritz approximation uX via (4). 


13.2. Using the trial functions $,(x, y) = (6-2x —3y)y and @,(x, y) = (6— 2x — 3y)y’ (and ¢, =0), 
construct the Rayleigh—Ritz approximate solution to the boundary value problem indicated in 
Fig. 13-1. 


u=Q 3 x 
Fig. 13-1 


According to Problem 13.1, we are seeking a solution of the form 


U2(X, y) = Cr di(x, y) + Crbalx, y) (1) 


The constants c, and cz must satisfy 


Aneit Ape2= Fy (2) 
Ac; + Anct2 = Fy 


where 
Amk = [ Vom > Vd: dx dy Fin = i: xXhm ax dy 
a 
Now, 
An = [ (36 — 24x — 72y + 4x? + 24xy + 40y’) dx dy 
2 
Ap= I, (72y — 48xy — 126y? + 8x7y + 42xy? + S8y*) dx dy = An 


An= [ (144 y? — 96xy? — 216y? + 16x’ y? + 72xy? + 85y*) dx dy 
a 


F,= [ (6xy — 2x?y - 3xy) dx dy Fy = [ (6xy? — 2x*y? — 3xy’) dx dy 
a 2 
For positive integers p and q, 


3 -2-(2x/3) 
[ xty*dx dy = | [ xPy4 dx dy 
a o Yo 


ptl5qtl 
3/2 


= [ 2a zy"! dz 
qt1 Jo 


3°*129*) pl(q+ 1)! 
qt+l1 (p+q+2)! 
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Thus, Au = 26, Ay = Aa = 163.2, Am = —499.2, F, = 1.8, F2 = 2.8. Substituting these values in (2) and 
solving, we obtain 
= 0.109 cs = —0.001 


_ 
we 
LPS) 


Construct the Rayleigh—-Ritz approximation to the solution of 
—ul'(x)+ u(x)=1-x O<x<1 
u'(O)= u’(1)=0 
using the trial functions (a) $,(x)=1, $,(x)=x, $,(x)= x7; (b) & (x)= x71 - x), & (x)= 
x'(1- x)’, &,(x) = x7(1- x)’. (c) Compare both approximate solutions with the exact solution, 


cosh x — cosh (1— x) 
sinh 1 


+1 


u*(x)= 


(a) In this one-dimensional version of Problem 13.1, 6 = .& = H"(0, 1). Let 


3 


ts(x) = >» Chi (x) 


i= 


Proceeding as in Problem 13.1, we find 


1 1 1 
‘re = Cy = 
2 3 2 
14 5 1 
ee | ere en es 
2 3 4 6 
1 5 23 1 
ey illic aus 
3 4 15-2 12 
whence é, = 0.5384, é, = —0.0769, 6; = —2 1078. 
(b) Letting 
3 
72) Fs S dihi(x) 
i=1 
we find 


0.0206 0.0103 0.0098 ][ d, 1/60 

0.0103 0.0068 0.0083 || ad | =| 1/140 

0.0098 0.0083 0.0115 || ds 1/105 
whence d; = ~12.177, d,= 48.87, ds = —24.06. 


(c) The comparison, Table 13-1, brings to light one of the weaknesses of the Rayleigh—Ritz method. It 
is evident that d(x) is a very poor approximation to u*(x). The reason is to be found in the fact 
that the functions y%(x) are linearly dependent: 


d(x) — da(x) — do(x) = xn(x)[L- x- (1 - x)] = 0 


The exact equations satisfied by the d; are 


i? 8 13 1 
630 1260 1260 as 60 
13. «47 49 1 
1260 6930 13860 de =| Fa0 
13 49 47 1 

as ne 


1260 13860 6930 


a 
So 
nA 
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Table 13-1 


0.5384 
0.53071 
0.52302 
0.5153 
0.5076 


0.4999 
0.4922 
0.4845 
0.4768 
0.4691 
0.4600 


This set of equations is inconsistent and has no solution. The system of (b) was obtained from this 
one by rounding off. Evidently, a careless application of the Rayleigh—Ritz procedure can lead to 
disastrous results. 

The functions y(x) and yo(x) compose an independent set and yield the approximation 


u3(x) = 7.76 d(x) + 1.02 Yo(x) 


Now, u3(x) turns out to be a less accurate approximate solution than d(x), even though it satisfies 
the boundary conditions of the problem, whereas &3(x) does not. This illustrates a second 
undesirable feature of the Rayleigh-Ritz approximation procedure: the success of the method is 
determined by the choice of trial functions. Unfortunately, there are no dependable a priori Clues as 
to what constitutes a “‘good” set of trial functions. 


Let Q, S, p, g, and f be as in Problem 13.1; in addition, let b= (6,,..., &,) denote a vector 
field defined on 42. Consider the boundary value prokiem 
—V- (p(x) Vu) t+ bO): Vat g(x)u = f(x) inQ (1) 
u=g(x)  onS, 2 
Ou 
— = g(x) on 5S, (3) 
on 


(a) Explicitly describe the construction of the Galerkin approximation to the weak solution of 
(1)-(2)-(3). (6) Show that if b=0 on © and ¢,= # for j=1,...,N, then the Galerkin 
approximation coincides with the Rayleigh—Ritz approximation as constructed in Problem 
13.1. 


(a) From Section 12.5, the weak formulation of (7 }-(2}(3) is to find u* in & satisfying 
K[u*, v] = Flv] for all v in A 
where 
#4 ={u in H'(Q): u=g, on Sy} 
AM ={v in H1(Q): v =0 on Sy} 


K{u, v] =| [pVu- Vout (b- Vat qu)v] an 
a 


Flo] = | joan | g2vd$S 
2 $2 
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Let ¢:,...,¢@n denote N independent trial functions from and let Wi,..., Wn denote N 
independent weight functions also from 44. Then, for an arbitrary > from s, the Galerkin 
approximation to the weak solution of (1 }(2}(3), 


N 


uk= 6) — (co=1) 


j=0 
must satisfy 
Kur, Um] = Fl | form=1,...,N 


N 
Saar (4) 


where, forl1sm,jSN, 


Ami =| [PVb; + Vim + (b- Vb; + 9b;)im] dO 
a 


Be =Flum)- | [pVbo- Vim + (b Vobo+ 9b0)m] dO 


Note that in general An; ~ Ajm. The solution cf,..., ch of (4) yields the Galerkin approximation. 


(b) Under the stated conditions, system (4) becomes identical to system (5) of Problem 13.1. 


13.5 Construct the Galerkin approximation to the weak solution of the problem 
AR ty) 2a, ay 1 in Q= {x >0, y >0,x+2y <2} 
u=0 on S, = {x +2y = 2} 

u,0,y)=y onO<y<1 

u,(x, 0) = 0 on0<x<2 
Use the single trial function (x, y)=(2—x-—2y)(1+x+ y) and the single weight function 
W(% y)=2—x—2y. 

We have ui (x, y)=ctd(x, y), where cf is given by 
ciK[¢, #] = Fle] 


Now, by computation, 


Kid, w= [bth + dy + Ode — 6, ute 14 


: 1 
Flip] = i want | yw(0, y) dy = = 


so that cf = —1/42. 


13.6 Describe explicitly the Rayleigh-Ritz procedure for approximating the eigenvalues and 
eigenfunctions of (12.8)-(12.9). 
Evaluating the Rayleigh quotient (12.72) at 
N 


a 
un = Py Cj 
jel 


where the ¢, are linearly independent functions in 0, we have 


A(c1,...,¢n) = J [un] = (1) 
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where Nor e= > { | lo4;-¥4.)+ 96/45) 40} co = 3) Anca 
ik=1 hkeowd 
S 
D(c1, Bh es ae tf. rhjbr ao} CjhCy = sS By; Cr 
k=l ikem 


Note that both A=[A,,]| and B =[8;,| are symmetric matrices. The conditions for minimizing (7), 


=H (m=1,...,N) 


translate to the matnx eigenvalue problem AX = ~ BX, where 
K={[c), C2,..., en)" w= HA(c,..., cn) 
Thus, 1, the smallest root (all of which are real) of the characteristic equation 
det (A- 2B) =0 (2) 


is the Rayleigh—Ritz approximation to A,, the smallest eigenvalue of (12.8)}-(12.9). And the components 
of X,, the eigenvector associated with 4, generate the Rayleigh—Ritz approximation to the eigenvector 
associated with A. 

Note that 


i= min J{d]= min J[¢] = Ar 


Ay Cty Ay 


The larger roots of (2) provide approximations for the larger eigenvalues of (12.8)(12.9), although the 
accuracy of these approximations, after the first, decreases very rapidly. 


Approximate the lowest fundamental frequency of a homogeneous circular membrane which 
is clamped at its edge. 


Choose units of length and time such that u(r, 6, £), the out-of-plane displacement at position (7, 0) 
at time 4 Satisfies 


un = V?ulr, 8, £) r<10<6<27,t>0 (1) 
u(1, 6, 2) =0 0<@<27,1>0 (2) 


Periodic, cylindrically symmetric solutions are of the form u = w(r)sin (A‘*t+ »), which implies for W(r) 
the Sturm—Liouville problem 


-(np'yY = Anp O<r<l (3) 
y(0) = finite, w(1) = 0 (4) 


Apply to (3}(4) the (one-dimensional) method of Problem 13.6, using the trial functions 
ur 3ar 
i(r) = cos a $2(r) = cos Be 


Thus, for j, k = 1, 2, 
1 


An=| roirdidr — Bu=[ rdi(r)dalrd ar 
0 oO 


which give 
a +4 3 nw 4 1 
16 4 4x? ca 
= B= 
3. On*+4 1 On’? — 
4 16 Wr 367° 


Solution of the characteristic equation det (A— 4B) =0 yields the Rayleigh—-Ritz approximations 
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by = 5.790 M2 = 30.578 (5) 


to A; and Az, the two smallest eigenvalues of (3)-(4). 
For comparison, the exact solution of (3}+(4) is yw = Jo(pr), where p is a zero of the Bessel function 
Jo(x). This implies that, to three decimals, 


Ar = 5.784 A2 = 30.470 (6) 


which testifies to the remarkable accuracy of the Rayleigh-Ritz method under a happy choice of trial 
functions. (Bessel functions resemble sine waves.) 


Supplementary Problems 


13.8 Using the trial functions $1(x)=x(1-—x) and $2(x)= x?(1— x), construct one-term and two-term 
Rayleigh—Ritz approximate solutions to 


—u"(x)~ xu(x) = x O<x<1 
u(0) = u(1) = 90 


13.9 Obtain a three-term Rayleigh-Ruz approximate solution to 


—u"(x) + (1+ x7)ulx) = x? O0<x<] 
u’(0) = u'(1) =0 


using trial functions (a) 1, x, and x7; (b) 1, cos ax, and cos 27x. 


13,10 Construct a three-term Rayleigh—Ritz approximate solution to 


Ux + Uyy = X x? + y?<100,x>0, y>0 
u=0 x? + y?= 100 

u,(0, y)= 0 0<y<10 

uy (x, 0) = 0 0<x<10 


using the trial functions 


$1 = 10-Vxr+ y? hr = xi b3 = yor 


13.11 Construct the Rayleigh—Ritz approximate solution to 


Ux + Uy = 1 inQ: O<xy<l 
u=0 on S$ 


using trial functions @1= x(x — l)y(y — 3) and @2= x*(x«- l)y*(y- 1). 


13.12 Construct a Rayleigh—Ritz approximation to the (singular) solution of the problem of Fig. 13-2, using 
N = 2, with $o(x, y)= 1 and 


oi(x, y) = xy 2x, y) = xy(1+ xy) 


13.13 Show that the Rayleigh—Ritz conditions (13.2) are equivalent to 
5) un; bm] = 0 (m= 1,2,...,N) 


1.e., the ‘“‘directional derivative” of J at uw must vanish in each of the N “‘directions” ¢,,. 
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Fig. 13-2 


13.14 Find the characteristic equation for the Rayleigh-Ritz approximate eigenvalues of the problem 


—u"(x) = Axu(x) 0<x<1 
u(0) = u(1)=0 


if the trial functions are , = x(1— x) and $2 = x7(1— x). (The true values are A; ~ 18.9, Az = 81.2.) 


13.15 Show that the eigenvalues of 


—u(x)= A u(x) O0<x<1 
u(0) = u(1) = u’(0) = u'(1) = 0 


can be obtained by minimizing the functional 


[ owe ar 
51] = ———— 
{, b(xy dx 


over an appropriate class of functions. 


13.16 Construct the Galerkin approximation to the solution of 


—u"(x)—4u(x)= x 0<x<1 
u(0) = u(1) =0 


using trial functions 
fi(x) = x(x - 1) 2(x) = x(x — 1)(x 3) 
and weight functions #(x) = 1, Ya(x) = x. 


Chapter 14 


The Finite Element Method: 
An Introduction 


The success of the approximation methods presented in Chapter 13 is largely dependent on the 
selection of an effective collection of trial functions ¢, and/or weight functions yy. If these functions 
are chosen from certain families of piecewise polynomials, called finite element spaces, the following 
advantages are realized: 


(i) It is possible to deal in a systematic fashion with regions 0 having curved boundaries of 
rather arbitrary shape. 


(ii) One can systematically estimate the accuracy of the approximate solution in terms of the 
adjustable parameters associated with the finite element family. 


(iii) The coefficient matrix and data vector for the system of algebraic equations defining the 
approximate solution can be efficiently generated by computer. 


14.1 FINITE ELEMENT SPACES IN ONE DIMENSION 


Suppose that the interval [0, 1] is subdivided into N subintervals each of length h = 1/N. Let 
x,=jh (j=0,1,...,N) denote the nodes in the interval [0,1]. Then the finite element space 
denoted by S"[k, r] shall consist of all functions #(x) defined on [0, 1] such that (i) on each subinterval 
Lx; Xj4,]1, (x) is a polynomial of degree at most k; (ii) #(x) has r continuous derivatives on {0, 1], 
which is to say, @ belongs to C’[0, 1]. 

If r=0, @ is continuous but not necessarily differentiable at nodes. If @ is to be allowed to be 
discontinuous at nodes, we set r= —1. Evidently, S"[k,r] is a finite-dimensional vector space (a 
subspace of L7(0, 1)) and so may be characterized by giving a basis; i.e., a linearly independent set 
of elements {¢,} that spans the space. 

Modifications for the case of nonuniform grids are easily developed. 


EXAMPLE 14.1 A basis for S”*[0,—1], the piecewise constants, is given by 
1 Xj-1 SX SX; 
j(x) = {, : ’ 


otherwise 


forj=1,2,...,N (Nh=1). See Fig. 14-1. The functions in $*[0, -1] are in L7(0, 1) but are not continuous. 


$;(x) 
1 
—————E_— 
Xo = 0 xj-1 x; 1=xN 
Fig. 14-1 
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EXAMPLE 14.2 By Problem 14.1, the ‘“‘hat functions” (see Fig. 14-2) 


pe Nee) XoSX EX 


otherwise 
(x = X-1M0G — 4-1) Xj-1 SX SX; 
(2) =4 (Ger Ve) SESH (GEL. N-1) 
0 otherwise 
a (x= {Oo D/Cin — X~-1) Xn-1 =X S XN 
wx) = 
otherwise 


where Nh = 1, compose a basis for $*[1,0], the piecewise linear functions. Note that this space is (N+ 1)- 
dimensional and that the basis functions have the convenient normalization $;(%) = 3 GU, k =0,...,N). The 
functions in $*[1, 0] are continuous and have square-integrable first derivatives on (0, 1]. 


1 
. “F ada) 
Xo = 0 x1 Xj-1 xj Xj+1 XAN-1 1= XN 


Fig. 14-2 


EXAMPLE 14.3 A basis for $"[3, 1], the piecewise cubic Hermite functions, is jointly provided by the two 
families (j =0,...,N; Nh =1) 


(lx -—x|—hP(Qlx-—x|+ Ahr wir SxS xa) 
(x)= | i 
0 otherwise 
(x — x,)(|x — x)|-— AY /h? Xj-p SX S X41 
(x) = i : 
otherwise 
See Fig. 14-3. Note the properties 
j (XK) = Six (Xe) = 0 
p(x) = 0 Wi(xn) = Six 
for j,k =0,..., N. The functions in $*[3, 1] are continuously differentiable on [0, 1] and have second derivatives 


which are piecewise constants (hence the second derivatives are square integrable). 


Fig. 14-3 
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14.2. FINITE ELEMENT SPACES IN THE PLANE 


Let © denote a bounded region in the plane and suppose that 0 is decomposed into polygonal 
subregions ,,..., Qy, called finite elements. Let h, denote the length of the longest side in ©, and let 
h = max h. Finally, let Q* denote the polygonal region that is the union of all the Q,. Note that if the 
boundary of 2 is curved, then 2" may not coincide with Q. We will denote by S"[k, r] the space of all 
functions @(x, y) which are defined on 9” and satisfy (i) on each Q, Cy y) is a polynomial in (x, y) 
of degree at most k; (ii) @(x%, y) has r continuous derivatives with respect to both x and y in 1". 

As in one dimension, a finite element space S"[k, r] will be specified via a basis composed of 
elements $,(x, y) associated with the nodes of the decomposition; i.e., with the vertices of the 
polygons. 


Triangular Finite Elements 


Let 2 be decomposed into triangular subregions, 0,,...,0,,, where no triangle has a vertex on 
the side of another triangle (a proper triangulation; see Fig. 14-4). Euler’s polyhedral formula shows 
that any proper triangulation into N triangles will have M nodes (vertices), where 


N+5 


=M=N+2 


Therefore, we expect S"(k, r) to be approximately N-dimensional. 


Aj 
(a) Proper triangulation (b) Improper triangulation. 
Fig. 14-4 
EXAMPLE 14.4 Let the nodes of a proper triangulation of M into N triangles be labeled z:,..., za. Then a 
basis for S"[1, 0], the piecewise linear functions on 0", is provided by the family $4(x, y),..., a(x, y) that is 


uniquely defined by the conditions 
(i) There exist constants Ajx, Byx, Ce such that 
(4, Y)= An t+ Bax t Cry on Oy 
for l<j<M,1<k<=N,; i.e., each @; is piecewise linear on 1". 
(ti) O(za)= 6; Usi j=M) 


The finite element space of Example 14.4 provides functions that are continuous on 2 (strictly, 
on 02") and have first-order derivatives that are square-integrable (but are generally discontinuous). 
These functions would be suitable for constructing approximations to the variational] solution of a 
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boundary value problem of order two. For higher-order boundary value problems, functions having a 
higher degree of smoothness are required. Functions that are continuous, have continuous first 
derivatives, and have square-integrable second derivatives, must at the least be piecewise cubic. Such 
functions may be generated in more than one way. 


EXAMPLE 14.5 Suppose that on each Q, the function ¢;(x, y) is of the form 
bj (x y) = Ajx + ByyX ab Cy + Dj.x? + Ejexy + Fy? + Gx + Hy (x?y = xy?) + Tiny? 


and, together with 2,@; and d,@,, is continuous at each node z;. Since there are 3 nodes on each triangle N,, we have 
3x3 conditions for determining the 9 unknowns Aj,..., x. The functions @i,..., 6a so determined 
constitute a basis for S"{3, 1]. 


Rectangular Finite Elements 


Retaining the notation of the preceding subsection, we have for any proper decomposition of 0 
into rectangles (where ‘‘proper”’ is defined as in the case of triangles) 


N+3=M=2N+4+2 


EXAMPLE 14.6 A basis for the space of piecewise linear functions on 0", $"[1, 0], is provided by the family of 
functions $1(x, y),..., @ar(x, y) defined by: 


() OneachO, GSk5N), 
(X,Y) = Aj t+ Buxt+ Cayt+ Daxy (UsjsM) 
(il) o,(2;) = 6, (sij=M) 


In fact, conditions (i) and (ii) uniquely determine the x(x, y) as products $i (x)¢(y) of the one-dimensional 
“hat functions” of Example 14.2. See Problem 14.4. 


EXAMPLE 14.7 Consider the space S”[3, 1] relative to the decomposition of © into rectangular subregions. A 
basis for the space is provided by the 2M functions 


bx (% ¥)= Pilx) G(y) Wa (x, y) = bi(x) u(y) 


(1<=k =M), where (x, y;) are the coordinates of vertex z, and where the @,, (x) and w(x) denote the piecewise 
cubic Hermite functions of one variable described in Example 14.3. 


14.39 THE FINITE ELEMENT METHOD 


When the solution of a boundary value problem is approximated by one of the techniques of 
Chapter 13 and when the trial functions are chosen from one of the finite element families, the 
approximation scheme is referred to as a finite element method. For problems in one dimension (i.e., 
for ordinary differential equations), finite element methods generally do not offer any advantage over 
finite difference methods. However, for certain problems in two or more dimensions, finite element 
methods provide distinct advantages over finite difference methods. On the other hand, the finite 
element approach requires complex, sophisticated computer programs for implementation, and the 
use of library software is to be recommended. 
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Solved Problems 
14.1 Let $, 6,,..., dy denote the hat functions of S"[1, 0] defined on [0, 1]. (@) Show that this is a 


family of N +1 independent functions in S"[1, 0] whose span is just S”[1, 0]. (b) Describe the 
relation between u(x) in C{O, 1] and U(x) in S*[1, 0], where 


(a) 


(b) 


N 
U(x)=> u(x,)b; (x) = x*=1) 
j=0 
If we write F(x) = codo(x) +--+ + cn@n(X) and suppose that F(x) vanishes for every x, then we 
must have co=c,=-''=c¢n =O, since F(x)=c (O=f7=N). Thus the @, are linearly in- 
dependent. To see that the $; span S*[1, 0], let v(x) be an arbitrary function in S"[1, 0] and form 
the function 


N 
w(x)= Dy )d(x) =x =1) 

j=0 
Now w(x.) = v(x.) for each k, since $;(%) = dx. In addition, w(x) and v(x) are linear on each 
subinterval [x,-1, x, ] and agree at the endpoints x,.-1 and x,. This implies that w(x) = v(x) on each 
subinterval and hence on all of [0, 1]; i-e., the 4, span S*[0, 1]. 
For arbitrary u(x) in C[0, 1], not necessarily in S”[1, 0], the function U(x) is the piecewise linear 
interpolating approximation to u(x); see Fig. 14-5. 


Fig. 14-5 


14.2 Let a regular hexagonal region, of side 1, be properly triangulated _as in Fig. 14-6. Compute a 
basis for S'[1, 0], the piecewise linear functions on Q'. 


The basis functions ¢;(x, y) satisfy the conditions 
dy (Ze) = Sn (i,k =1,..-,7) (1) 
O)(% y) = Aje + Bix + Cry on Oy (j=1,...,7; K=1,...,6) (2) 


The coordinates (x, y.) of the node z, are as follows: 
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Van 


Then, on Qi, 1(x, y) satisfies 


Oi(z1) = Aut Bud) + Cu(V3/2) = 1 Lox yi Aun 1 
$i(z2) = Aut Biu(2) + Cu(V3/2) =0 or 1 x2 ye By |= 
1(27) =Auyt B,,(3/2) no C\1(0) =0 1 x7) 7 Cir 0 


and hence, j 
M 


3 1 
oily yy=--xt+—=y — for (x, y) in On 
2 V3 


Continuing in this way to use the conditions (7) and (2), we can solve for each $(x, y), the linear 
function representing ¢;(x, y) on the triangle Q,: 


bul yas—xt Ty tals, y)= S++ ey Beets 
1 1 1 
CE ey a aa 
pis(x, y=2-<y do(x, y) = 0 (k =3,4,5, 6) 
bul y)=—+x-—Ly 
2 V3 

fil 1 
Oley) 2 ee 

= 2 
hilX, WR 


Note that ¢2(x, y) vanishes identically off of OQ, and Oz. This is a result of condition (7). Because 
only QO, and Q2 contain the vertex z2, @) must vanish at all three vertices of N3, N4, M5, and Qs. But do is a 
linear function of x and y on each M, and hence $2 must be identically zero on O3 through Ox. It follows 
from this that on each triangle 0, there are just three of the ¢, which are nonzero: 


On: du, bra, On Og: rz, ox, 32 pee OX: his, bos, O76 


Evidently, ¢j. is nonzero only if z, is a vertex of O,. This leads to the following somewhat more efficient 
algorithm for generating the nonzero ¢yx. 
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Input Data: N = number of triangular subregions 


M = number of vertices 


Table |. Coordinates of vertex z; (1S); M) 


Table Il. List of vertices z* that belong to triangle Ox 


k k k 
k ZY 22 23 


Algorithm: FOR K=1 to N 
FOR L=1 to 3 
Find J = 1(L, K) such that z) = zt 
Load Lth row of 3 x 3 coefficient matrix [M] with (1, xj, ys) 
FOR L=1 to 3 
ALK 
Solve: {M] Bix = [ex] 
Cix 


where [e,| = unit 3-vector with a | in the Lth place 
Save: Acx, Bix, Cix 
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Output: Three 3X N matrices, A=[Ay], B=[8x], C=[Cx], containing the coefficients needed to form 


Ox (X% y) = Ant Bux + Cry (=1,2,3; k =1,2,...,N) 


Note that the index / is not necessarily the number of the vertex at which ¢@= 1; the /-value of that 


special vertex may be read from Table JI. 


In the present problem, N = 6, M = 7. Table I has already been given; Table II is as follows: 


Applying the algorithm then leads to 


On Ox: ges ee ey On Qh: Hite i eress a 
os V3 2 V3 
3 1 at 
ere. tena! 
2 2 
¢1=1-—=y f3=-1+—=y 


V3 V3 
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onn oi=2 z Onn m) a : 
In Os: 1=2-—=y n Qa: PSS eee Sey 
V3 2 V3 
1 
gs=—-+xt— zy ga=—1t+—zy 
2 V3 : 3 
: 1 nal é 3 1 
4H 7 —xt—=y = --x-—=y 
2 V3 ae V3 
Onn od a + : On 2 ? g 
n Qs: =—--+xt+— xy n (6: 1=—y 
: 4 V3 We 
P 1 oe ; 3 1 
s= ~~ xt—=y ea soko y 
2 V3 2 V3 
d6=1 2 ¢ a : 
SS eet ey 
: V3 2 V3 


Let £2 denote the circular region indicated in Fig. 14-6; the boundary S (dashed circle) is 
supposed to be partitioned into arc S,, the minor arc between nodes 2 and 3, and the 
complementary arc S,. Solve by the finite element method 


uy, + uy, =0 ind 
Ou 
—=0 on S, 
on 
u=g8 on S, 


under the assumption that g(z,) = g(z;) = g(z,) = 100 and g(z,) = —100. 


A finite element solution would consist in applying the Rayleigh—Ritz procedure (Section 13.1) to 
the functional 


J[u]= I. (uz + u2) dx dy 


with trial functions drawn from S*{1,0]. In terms of the basis functions ¢1,...,@7 ascertained in 
Problem 14.2, we take as “ the subspace spanned by ¢1, ¢2, and 3 (these vanish, as is required, at 
nodes 4, 5, 6, and 7, where u is prescribed). As the function ¢@o from ss, which must assume the 
prescribed boundary values, choose 


ho = 1004+ 100@5 + 100h6 — 1004, 
Carrying out the minimization of 
H(i, C2, €3) =J [dot cidi + C22 + Crabs] 
we obtain ct = 42.85, c3 = 8.56, c} = 48.56. Our piecewise linear approximate solution is therefore 


u3(x, y) = 42.85 di(x, y) + 8.56 h(x, y) + 48.56.63(x, y) 
+ 100[ pa(x, y) + s(x, y) + be(x, y)— Gry y)] 


An L-shaped region {2 is decomposed into squares, as shown in Fig. 14-7. Construct a basis for 
the piecewise linear functions, $“[1, 0], on Q' = Q. 


Let node z, (k =1,2,...,19) have abscissa x; (@=0,...,4; see Fig. 14-2 with N =4) and 
ordinate y; (j=0,...,4; replace x in Fig. 14-2 by y, and again take N = 4). (It is obvious how the 
foregoing would read if the decomposition were into rectangles, with different numbers in the x- and 
y-directions.) Then the basis functions for $'“[1, 0] are given by 


x(x, y) = bi(X) $(y) (1) 
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14.5 


x=l 


Fig. 14-7 


To make (1) explicit, read off from Fig. 14-7 the values of i and j answering to a given k, and then 
appropriate ¢i(x) and ¢;(y) from Example 14.2, with /(1/4) substituted for x; or y;. For instance, 


dala y) = bu(xidaty) = | fa a Se ak wee 


otherwise 
Consider the boundary value problem 
Shy = inQ (1) 
u=Z8 on S, (2) 
Ou 
—=h on S, (3) 
on 


where ©, is the region of Problem 14.4, S, is the intersection of the boundary S$ with the 
coordinate axes, S,= S~— S,, and where f, g, and h are prescribed functions of (x, y). Set up a 
system of linear algebraic equations for the coefficients in a finite element approximate 
solution to (1)—(2)-(3). 


The procedure parallels that of Problem 14.3, this time we appeal to Problem 13.1, wherein were 
developed the Rayleigh—Ritz equations for a class of boundary value problems including (/)—(2)-(3). 
Thus, in Problem 13.1, set n= 2, p=1, gq =0, 8: = 8, g2=h. Rewrite (4) of Problem 13.1 as 


10 yg 10 
Uio(X, y) aa hol x, y + > Cur (X, y= >» 8 (Zn) D(X, y)+ ey ChB (XG y) 
k=) kell k=1 
where the ¢x(x, y) are the basis functions for $’“[1, 0], as given by (1) of Problem 14.4. Then the desired 
linear system in ¢),..., Cio is 
10 


S Ameer = Fn (m =1,..., 10) 


k=t 


with 
Amk -{ Vedula, y)* Vbu(x, y) dx dy 
ng 
10 
=D] Von(x, vy) Vobx(x, y) dx dy (4) 
ral 7, 
and 


Fn={ fls dale y)dedy+| hs y)dmlx, y)dS— | Vn Vao de dy (5) 
2 S2 2 
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In (5), f(x y) and h(x, y) are to be replaced by their piecewise linear approximants (see Problem 14.1) 


19 
F(x, y)= > fz) dix y) for (x, y)inQ 


H(x, y)= > h(z)oi(%y) for (x, y) on Sp 


i=4 


To illustrate the application of (4) (and to indicate why such matters are normally consigned to the 
computer), let us evaluate Ai2 (= Aa). Since (refer to Fig. 14-7) 


(1 - |4x — 1)(.—|4y - 1) on O1,UN6U 17 U Og 
0 elsewhere 


d(x 9) = bulxdduty)= { 


(1- |4x — 2))(1 - [4y — 1]) on 0,002,025 U 
0 elsewhere 


bx, 9) = balx)orty)= { 


it follows that 


Vdilx, y)* Vbolx, y) = bi(x) b3(x)[dily)° + dilx) bax) [6i(y)? 


has the representation 32(1 — 2x)(4x — 1) — 256y” in {¢, takes mirror-image values in Q,, and vanishes in 
all other 0,. Hence, 


V4 1/2 1 
An=2] dy | (32(1 — 2x)(4x — 1)~ 256y?] dx = ~ = 
0 4 3 
In similar fashion, the constants F,, can be evaluated by one-dimensional integrations of (at worst) 
quadratic functions. 
The analogous procedure in the case of a decomposition of © into triangles 9, is somewhat more 
complex, since it involves the calculation of integrals of the form 


|] xrytdedy =p, g2) 
Ny 


On the other hand, for a given degree of accuracy, the dimension M of the triangulated problem will 
generally be lower than that of the rectangular decomposition. 


Supplementary Problems 


For the triangulated hexagon (h = 1) shown in Fig. 14-8, use the algorithm of Problem 14.2 to generate a 
basis for the piecewise linear functions, $7{1, 0]. 


Consider the three-lobed region 2 in Fig. 14-8 bounded by the dashed curve S. Let S; be the circular arc 
centered on node 3, and let S; be the remainder of S. Using the approximating functions developed in 
Problem 14.6, solve the following problems by the finite element method: 


(a) Ux, + Uyy = 0 inQ 
u=g8 on S 
where g(zs) = g(z9) = —g(211) = —g (212) = 50, and g = 0 at all other boundary nodes. 
(b) Ux + Uy, = 0 in 
ou 
—=0 on S; 
on 
u=e2 on S2 


where g(za)= g(z9) = —8(211) = —g(Z12) = 50, g(Z10) = 0. 
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Fig. 14-8 
(c) Uxx + Uy = 0 inQ 
ou ——s 
—=0 on 24Z5 
on 
u=g on $ — Z4z5 


where g(Z6) = g(211) = 10, g(27) = 8(210) = —8(Z12) = 30, 8 (Zs) = 8 (29) = 50. 


14.8 A two-dimensional region Q, formed by cutting a groove in a rectangle, is triangulated as in Fig. 14-9 
(Q = 2). Generate by the algorithm of Problem 14.2 a basis for S¥*{1, 0]. 
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Let S=S,US, denote the boundary of the region Q of Problem 14.8, where S, contains nodes zg 
through z,.. Using the approximating functions developed in Problem 14.8, solve by the finite element 
method 


Ux, + Uy, = 0 inQ 


u=geg on S; 
Ou 
—=0 on S, 
on 


if (a) g(Zs) = —g(216) = 5, g(210) = B(215) = 9, B(2Z11) = 8(Z14) = 2, 8 (212) = 8 (213) = 4; (B) B20) = 8 (210) = 
&(211) = 0, g(Z12) = 5, g (213) = 10, g(z14) = 8 (216) = 20, 8 (215) = 30. 


In Problem 14.7(a), show that 


1 
u3(21) gu 5 (22) + U3 (z3)+ U3(z7) + U3(Zs) + U3(Ze) + U3 (Z10)] 


thereby verifying the numerical mean-value property of finite element approximate solutions of 
Laplace’s equation. 


Answers to Supplementary Problems 


CHAPTER 2 


2.19 


2.23 


2.24 


2.25 


2.26 


2.28 


(a) h. everywhere; (b) p. everywhere; (c) e. everywhere; (d) h. |x| > 1, p. |x| = 1, e. |x| <1; 
(e)hoy<e* pyre*7e yore *;(fp~hx<0,p.x=0,e.x>0; 

(g) h. xy(xy+1)>0, p. xy(xy + I) =0, ©. xy(xyt 1)<0; 

(A) h. xy(xy-—1)>0, p. xy(xy—-1)=0, €. xy(xy—1) <0 


(a) p(txx + Uyy), elliptic; (b) —p(us + uyy), elliptic; 
(C) Un ~ p(Usx + %y), hyperbolic 


(a) y=const. (e) log|y|+x=const. (y #0) 

(b) 2x—y=const.,2x-3y=const. (ff) x?+ y?=const. 

(c) x+y-=const. (g) 5x+2(-yy"=const. (y <0) 

(d) x+2V-y=const, (y <0) (h) 3x+2(-y)?= const. (y <0) 
2 4 

é> ge UG 


A. = 1, A2= 3, A3= 4 (all positive); 


1 1 1 
ee nae &2 = —= (x1 — Xs) ae mn Ne 


v2 


ni = 1, 2 = 2/V3, 3 = 3/2 


(a) elliptic (A, = 2, A2= 2, A3= 4 all positive) 


1 1 
(b) ae 2 = X2 ee ale 
m= &IV2 m= &/V2 — n3= 6/2 
(a) €=4x-y, n=2xt+y (c) £= (1+ V6/2)x— y, 7 = (1- V6/2)x - y 


(b) £5 @F eaves donee Vey. ) o= V2)" =e", = (1 ~V2}e"—e? 


A 


= ee -1 = -J - 
n= (x+1P—xVx2 + 1~ log (x + Vx? + 1)-2y (e) €=tan"'x—tan'y, y=tan”’ x+tan y 


(a) elliptic: € = y, y = x + (x7/3) 
(b) elliptic: €=x+2y, n = 2x 
(c) parabolic: =x, 7 =y+x 
(a) hyperbolic: already in canonical form 
(e) parabolic: = x, y = y/x (x #0) 
(f) hyperbolic: € = xy, 7 = x/y (xy ¥ 0) 
(g) same as (f) 
(h) parabolic: = x, 4 =2x+ y? 
(i) elliptic for xy > 0; € = 3] y|'7, n = |xP? 
(j) elliptic for xy <0: € = |y?, » = |x? 

hyperbolic for xy > 0: € = [xP —- [y?>*, n = [xP +|yP? 
(K) parabolic: = x, 7 = e*-e” 
(4) elliptic: € = log (1+ yl, 7 = x 
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(m) parabolic: = x, 4 = Vu-Vy 
(n) hyperbolic: = y tcescx—colt x, y= y+cscx+cot x 
(0) hyperbolic: € = x*—2e’, 7 = x? + 2e” (x #0) 


(p) parabolic: =x, 7 =tan 'x+tan 7 y 


u(x, t) = e°***"v(x, 2) 


CHAPTER 3 


3.38 0 
3.39 4 
“ie b) 16 om A I ( 4 ) 
3.42 Onn = m and a even), 

( mw m?-1 n?-1 2-mM-n? 

Amn =O (m or n odd and mn # 1), ay arbitrary 
CHAPTER 4 
4.158 uly, )=r[F(r-at)+ Girt at)} (r>0) 
4.19 (a) u(x, y, ) = expf[A(ax+ By — wt)], where A*[?— (aa) — (Ba)*] = 67; (6) p? = b?-2 
4.23 Uf ve(x, ¢; 7) solves 
v(x, £) = Vev(x, 2) xinR", £>7 
v(x, 7) = F(x, 7) xin R®” 
then u(x, d= { or (x, t 7) dr 
O 
satisfies u(x, t) = Vu(x, t)+ F(x, 0) xinR"’, 1>0 
u(x,0)=0 xin R” 

4.24 


1 f 
u(x, d=5-| [F(x + a(t—7))— F(x - a(t—17))| dr 


where F(s) is an antiderivative of f(s). 


CHAPTER 5 


5.22 


Hyperbolic if u?+ v? > ¢? (supersonic flow), elliptic if u? + v2 <c? (subsonic flow). 


Diy — 022 


(4) 


Uy — U2 
(a) u(x, y) = f(x/y); (b) along the line y = x/¥ 


(a) x?+ y?=1, u=2; (b) x+y? =1, w= eS xr? 


(a) w= b(t a)(——*) 5 (6) w= log e+ ») + Z +( = ) 


x+y xty 
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ey 


§.28 (a)u=e(x-ct)t i b(ert+x—ctr)dr; (b) u=e (<- | f(z) dz) e° 


I 
§.31 (a) u= 7 [6 sin (x — 32) - 6cos (x — 34)— sin (x + 21) + 6 cos (x + 21)] 


I 
v = -[sin (x ~ 31)— cos (x ~ 32) ~ sin (x + 28) + 6 cos (x + 28)] 
2 
I 
(6) w=sin(xt+y), v= ; [Ssin (x —2y)+ 6e*"”” — 8sin (x + y)] 


5.32 See Fig. A-1. 
i 


-= 
zm 
a“ 
eV ae 
car & Coe anil 
- 
~~ 
a a 
- ~~ 
i = on 
p=R/3 


=0 


Shock: o'(f) 


Fig. A-1 


CHAPTER 6 


6.8 (a) ao=1, a, =0 and b, = (1—cosam)/n7 for n= 1,2,... 
(b) ao= 7, Gn =2(cosnn-—1)/n*a and 6, =0 for n= 1,2,... 
(c) ao=0, a, =0 and 6, =—2(cosna)/n for n=1,2,... 


6.9 By Theorem 6.1, the series for F and H converge pointwise, while the series for G@ converges uniformly. 


6.10 (a) 473 (2n — ly! sin (2n-1)x; (6) 1 


n=l 


6.11 (a) A,=(na/€P and w,(x)= sin Ai?x for n= 1,2,... 
(6) An =([(n-4)a/€P and w,(x) = sind? x for n= 1,2,... 
(c) An =((n—-3)a/€P and w,(x) = cos aAl?x for n=1,2,... 
(d) A, = 42, where pu, is the ath positive root of uw = tan wé, and 
: sin Men(x = ¢) 
W(X) = SIN pepX — My COS aX = ———— 
cos pn 


forn=1,2,.... 
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(e) A-1=—u24, where p-1 satisfies e? = (wu + 1)/(u — 1) and w-4(x) = exp [—p-1(2¢ — x)] + exp [—w-1 x]. 
For n=1,2,...,An =#4, where yu, is the nth positive root of w tan wé = —1 and 
Wa(X) = SIN aX — Uy COS Ux = [COS upa(x — O)/sin pA. 
(ff) If €>a-— 8B, then A_,=~p2;, where y_, satisfies 
em = (1+ ap)(1~ Bu) ~ aw)(1 + Bu) 
and w-i(x)= (ap — 1)(aw + Ie**-e“*; if C= a— PB, then Ao=0, with wo(x)=x-—a@. For n= 
1,2,..., An =, where yw, is the nth positive root of (1+ eBu’) tan we = (a — B)u and w,, (x) = 
SIN MaX — py COS Unk. 
6.13 Theorem: F.(x) is C* if f(x) is continuous on {0, @] for j= 0,1,..., p, and if 
FO) = FO) =0 
fork = 1,3,5,...=p. 
4 od (-1)"*? é 3 00 ~ 
6.15 (a) Ss zsin (2n — 1)x (c) 7*+12 >. (-1)"n7? cos nx 
T pat (2n— 1) n= 
4< (ene ~ se 2 - a 
(6) —> cos (2n -- 1)x (ad) -12 D9 (-1)'n? sin nx + 20? SD (-1)'n7' sin nx 
Warn, 2n-1 n=1 n=l 
‘ sin 1.5(a@ — 2i >. Sl i 
6.19 F(a)= e@ fe Ka-2i) In (@ - i) G(a) = e fe SIn @ det SUL 
a(a —2i) Ta TH 
ae -id(x-y) ,-2Ix-yl 
6.20 ;{ ene Hey) dy 
es fis) 6as? - 2a° 5(s) s—b 55) ees 
. == $s) = —— s)=——r- 
(stay (s— bf +a? . s s 
: FO) (ft 7) k ‘ 
6.22 (a) (t-3PH(t-3) (b) =| dt (c) eo" ———~e**™ 
Vat “9 Var V4arke 
6.23 Let a, =(2n+1)b- a and B, = (2n + 1)b + a. Then, 
- Ios 2 2 
F(t)= > [H(t- an) + H(t Br)] G(t) = —= © [exp (—@2/4t) ~ exp(—82/40)] 
n=d V Tt nro 
CHAPTER 7 
7.9 u(x, t) = uC, t) + we(x, 1) + us(x, 8) 


ur(%, t) = golt)(x — x7/2€) + g1(1)(x7/20) 


1 = 
uAG 1) = fo. 2) fa EXP (= WAKE) COS pnX 


n=] 


2 é 
where p,=n7/€ and, if go(0)= g1(0)=0, f,= =a f(x) cos px dx 
0 


u3(x, t) = i E Fo(r) + > exp (-2.«(t— 7)) F,(7) cos pn dt 


n=l 


where F(x, 1) =F [eo(t)— gx(t)] — gd(t)(x — x7/20)— g3(t)(x2/2€) and 


2 é 
F(t) = =| F(x, t) cos p,x dx 
Clo 
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7.20 u(x, t)= ur(x, t)+ ue(x, £1) + uals, 1) 
u(x, 1) = golt)+ xer(t) 


un(x, t= >° f, exp (—u2«t) sin wnX 
n=! 


2 & 
where w,=(n—3)a/€ and f= | f(x) sin wx dx 
a 


t 


u3(x, t) = | Ss exp (~2«(t— 7)) F,(r) sin penx | dr 


io) 


2 é 
where F(x, 1)=—gi(t)—xgi(t) and F,()= Al F(x, :)sin wx dx 
0 


7.210 ulx, ft) = uy 1) + tel, 1) + u(x, 2) 
U(X, £) = Bo()P(x) + gilt ¥(x) 
where @(x)=(e?*9-1W/p and W(x) = e%© 


co 20 


w(x, = >) fr exp (—w2«d) (sin wx — Pity COS UX) = > Jn exp (-#4x«1)sin u(x — @) 
n=l nat COS Mnl 


2 1 £ 
where py, =tanyu,€ and f, =y = Al f(x) sin pa(x- 0) dx 
COS” Ln 0 


a OT es ae: a sin n(x — @) 
u3(x, f) = j [= exp(—#iK(t— 7)) F,(7) earner ee Jar 


where F(x, 1) = K[go(s)P"(x) + gi(ty¥"(x)] — go()®(x) — gi (NY (x) 


eae" 1 
bcos? nl 


[ F(x, ()sin w(x — @) dx 


—2bx + (4Kc — b*)t 
4x 
vilx, 1) = Bolt)(L— x/@)+ gr((x/@) 


cs 


7.22 u(x, =exp | [vi(x, 1)+ v(x, H+ vs(x, D] 


v(x, = > fn exp (~uankt) sin nx 
a=l 
2 é 
where yu, =na/€ and f, =5/ ef" F(x) sin penx AX 
Q 
v3(x, t) = [ [> exp(—u,.K (t— 7)) F, (7) sin pent | dr 
ie) n=l 


where F,(1) =| [—go(t)(1 - x/@) — gi()(x/8)] sin wx dx 


7.230 u(y d= j O(x — &, KA f(é) dé +f kK O(€~ x, «(¢— 7)) @1(7) dr — f. Kk @(%, K(t— 7)) go(7) dr 


where K(x, 1) =(4mt)'?e7*" and O(4,)= DS) K(x +2né60) 


nao 


7.24 u(x =—-K [ K(x, K(t— 7)) @(7) dr (see Problem 7.23) 
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00 


7.2500 u(x, t)h=- | e PO y(y, t) dy 


x 


v(x, = « { h(x, «(t— 7)) g(7) dr 


x 


V 4a 


ent 


where A(x, 1)= 
7.26 u(x, t= { eS h(x + b(t— 7), K(t— 7) f(t) dr 
9) 
1 _ . 1 xt+at _ 
7.27) = =u(x, t= 5 [F(x + at)+ F(x — at)| + Ja | G.(s) ds 
a x~at 
where F; is the even, 2¢-periodic extension of f from (0, @) to (-~, ~). 


7.28 u(x, t= Fas + at)+ F,,(x- at)]+ - [~ Gn (s) ds 


x—at 


where the mixed, 4¢-periodic extension of f is defined by F,,(x + 4@) = Fa(x) (all x), together with 


f(x) O<x<@ 
F,,(x) = 4 —f(2@- x) 0<x<20 
f(x) -2@<x<0 


=“ € ¢'¢® . nax | nay | naa(t~7) 
7.29) u(x)= > | { sin sin sin f(y, 7) dy dr 
n= LATA Jo 4o € € é 


7.30 u(x, t= > gne- sin p,t sin ux 


where p,=nal€ p,=Varp2-c?, g.= 


é 


g(x) sin px dx. 


NTAPy /o 


t 


73100 u(x, = { [> gre “"” sin p,(t — 7) sin pt | dt (cf. Problem 7.30) 


0 n=l 


7.32 u(x, t)= >) {g(t En(€— x))- g"(t- O,(x))} + > {f(t En(x)) — Ff" — On(€ — x))} 


2n€+ x (Q2n+ l@+x 
where E,,(x)= , O,(x)=————., and 
a a 


(see Table 6-3, line 6) f*(t— b) = H(1~ b)f(t— b). 


oo oy 


733 u(x,td=a {G"(t— E,(@- x))+ G"(t— O,(x))}- a SS (F*(t— E,(x)) + F*(t- O,(€ - x))} 


n=0 n=0 


where F(1)= j f(r) dr, G= [ (7) dr. 


oy @ 


7.34 u(x, t)= D {((-1)"9"(t- E,(€— x)) + g*(t— O,(x))}— a 3S ((- 1" F*(t— En(x)) — F(t O,(€ - x))} 


n=<0 n=O 


(cf. Problem 7.33) 


7.35 u(x,)=-F*a-—x/a) (cf. Problem 7.33) 
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736° -ulx, )= == x/a) | GO vaya 
xla 
7.37 u(x, y) = us(x, y) + Uo(x, y) + a(x, y) + ua(x, y) 
= h J- 
u(x, y)=— Df = ma 2 cos nary 
nel nm sinh na 
L 
where f, = 2| f(y)cosnmydy (n=0,1,..., fo= 0 (for compatibility) 
ie) 
u(x, y)= —u,(1—x, y) with f replaced by g 
u3(x, y)= u(y, x) with f replaced by p 
u(x, y)= —ui(y,1—x) with f replaced by q 
1" 
7.38 u(r, 0)— u(0, A)= — al log [1~ 27 cos (@- %)+ 7°] f(b) dd 
TT dag 
ie = NOY eo 
f u(r, Zinn B= (a/by sin n 
1° 
740 u(x y)=5— | tog [(2? + (y+ 22+ (9 ~ 2S) dz 
TT /o 
1? 
+= | log ly? + (x+ zP)(0?+ ~ z))) a2) dz 
Qa fey 
TAL u(x, y)= f(x)(y —2y7)+ B(x) y7 + O(%, y) 
2 4 5™ 1 
v(x, y)= > —| er orlenal I H(z, 8) cos nas cos n7ry ds| dz 
n=l FIT 400 fo) 
where H(x, y)=2y(f"x) ~ g"(x)) + f(x) - g(x) 
r-1f™ 
7.42 u(r, @)= | Ho) dp 
Qn J.,1-2rcos(@~od)+r 
J 7 
743 u(r, A)=+ =| log [1 - 2r cos (0 — @)+ 7] f(b) db + const. 
Jan 
CHAPTER 8 
8.21 (a) 2H(x)- 1; (b) &(x); (c) 0 831 (a) Ltluj=uxt+iuy—u,t+uy+3u 
(b) L*[u) = ua t uy 
Die k k fi. <2) k k Ty) — s 
8.22 S sin aay me += > cos HE aoe mé (c) L*|4) = tax ~ Ua 
i aes ae el J (d) L*[u] = dex + ty — (xu) ~ (yud)y 
wo ) (e) L*[u] = tet uy — yu — xUy 
823 G(x;8)=- 5 OH) (f) Lt[W] = Gude t+ (7A) 
noel An Bi € 
eae oa onen mea a 
824 G(x, ys n)=—— Se sin ™™ gin 2 bR, + cRy + (be + 6 — e)R = 0 
ac A) a a 
must be solvable for R (R # 0). 
8.26 (a) G(x, y; & 1) = Gol% ys & 1) — Golw ys —& 0); 


(b) G(x, y;3 & 0) = Golx, y; & 0) + Golx, y; -& n) 8.36 R=e* 
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8.37 (a) L*[v)= vu + v,,- 20. -3v,, v= 00n x =O and x =a, v,-3v=00n y=Oand y=5; 
(d) LIG|=8 -~d(y-n) O0<x,E<a0<y,n<b 
G=0 onx=OQandx=a 
G, =0 on y=Qand y=b 


ew aly! 
sin nx, where A, = [9+ (n7¥J'”. 


8.38 uae” S (1) 
ne An 


8.40  u=erf (x/V4xt) 


U U é- é+ 
8.41 (a)u=Uerf * ; (b) u= Uertc Z ; () u=— (1+ erf = ); (d) u= (ert Sheet 2 : 
V4Kt Akt 2 Va4Kt 2 V4kt V4Ke/ 
€-x +x U x-—b x+b x-C xte 
(e) u=— (erte + erfc ); (f) u (ert + erf erf erf ) 
VA4xt VAkt VAkt Va4xt VAkt VAkt 


8.43 (a) Git; &7)= K(x-€¢t-7) and u(a, n= | i G4 tb & If agar | G(x, ts & O)A(E) dé 
(6) K(x-&t—7)-K(x+ &e—7) and 
[ [cons nnenacdes [oon goneas+s f’Gxls,50, pC) ar 
(c) KQ-&t-7)+K(x+&t—7) and 
[ [ cwssnnen agdr+ |” Gx, 1; & 0)h(8) ae [, Ot 6:0, p00) de 
(d) D [KG ~ 842612) Kee £4 nl c=) and 
i [ oe bE ONE 1) agar | "G(s KE) de + « [ [oe 150, 7)p(1) ~ Gelx, #3 6 1)q(x)) dr 
(e) > [K(x- £4 2n€ 0-7) + K(x + €+2nt-7)] and 


n=—0 


ea G(x 5 & IME 7) dé dr + | Gla bE OKE dE + « | [Gx 6; & 7) q(t) — G(x, £0, 7) p(s)] dr 


1 
8.44 GO Gh ks) =k ea) (Hats) |x — €|)— H(a(t— 7)- |x + €))) for ¢> 7. 


2 1 | maa(t-7T) mmx mar€ 
845 (a) Gi4térn=-— > sin cos cos for (>. 
a moda NT é g é 
12 
(6) Gi4t&ér= ee DS [Hlatt—1r)-|x - €-2n€))- H(a(t—17)- |x + €-(2n-1)4)] for £> 7. 
Q na=-« 


CHAPTER 9 
9.16 (6b) It is possible for the roundoff errors to dominate the truncation errors. 


9.22. (a) In the notation of Problem 9.13, with r=k/h? and s =(1+ 2r)- k, 
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S or 0 Uy, jai U;; 1 
—r aK a U2 j+1 U3; 
-roogs —r Us js Us; 
-r -r Un-2,j+1 UN -2.j 
L 0 5 || Un-1j+1 | Un-1,j | 
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(b) By Problem 11.11, all eigenvalues of the above matrix C are greater than or equal to 1. Hence the 
method is stable. 


9.23 (a) U_,., = 25, Uo: = 50, U,, = 25; other U,,; = 0 
U_22 = 6.25, U_;2 = 25, Un = 37.5, U2 oe 25, Ux = 6.25; other Un2 = 0 
(b) U_i = 100, Uo = —100, Uy = 100; other Un =0 


U_22 = 100, U_,2= —200, Un = 300, Uy, = —200, Un = 100; other U,2 =0 


9.27) With h = @/N, (Xa, &) = (nh, jk), r= a?kfh?: 


Un jer = Une gt L~27)Ug + Une (2 =0,1,.0.,N 15 F=0,1,2-.) (1) 

Uno = f(%n) [starting values for (1)] (2) 
Ui; - UL; ae 

aUo; + B — as p(s) [used to eliminate U_,,; from (1)] (3) 

Un, = a(t) [used to eliminate Uy, from (1)] (4) 


9.28 With h=1/N, (x,, 4) = (nh, jk), r= a7ksh?, 5 = ck/2h: 


(~r~ s)Un-1 jar t+ (0+ 27)U a jar t (or + SU nat joi fae U,; (n aa 1, 2, re 
USO) GI NST 
Cae ea eo 
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cos (8/2) — isa sin (B/2) a 
cos (8/2) + isa sin (B/2) 


10.14 |é|= 


10.15 (2) 5? Um, — $7C?(8% Unmj + 8% Unnj) = 0 (5 = k/h); (b) c?8? <3 


10.16 (a) u(x, t) = 3[cos (x — 22) + cos (x + 22)], u(0, 0.04) = cos 0.08 = 0.99680 
(b) U2 = 0.99680; (c) Up ~ 0.99840 


10.17 (a) 87U,; = (c?s7)8% Un; = kKb(U, +1 = Un j-1) 
(b) Stable if c?s?=1. 


(s = k/h) 


10.18 (a) u=log x +2 log y; (b) me 6B = const., xy = a = const. 
x 
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10.19 (a) Ya = — Xa XY (Ux a ~ y*(Uy Ja = Ya 


Ya =~ — Xp —xy(Ux)e ~ "(Uy )a = Ya 
and Ua = UXy + UyYe OF Up = Xp + UVa 


(b) P=(V42,3V4.2) 


(c) Numerical 


0.48795004 0.48795181 


1.95180015 1.95181085 
J 


0.33281394 0.37422268 
0.34661688 


10.21 (b) yeo”’* = B=const., ye? = a = const., P = (W5/2, 2e*) 


10.22 


Exact V 5/2 = 1.581 2e%* = 4.234 2e°/4 = 4.234 V 5/2 = 1.581 xy ~ 6.694 


Numerical * 5/3 ~ 1.666 10/3 = 3.333 10/3 = 3.333 5/3 = 1.666 50/9 = 5.555 


* The tterative method of Problem 10.5 could be used to improve these values. 


10.23 (a) Us, = 0.2727, u(1, 0.2) = 0.2076; (b) Uro.1 = 0.4925, u(1, 0.04) = 0.4906 


10.24 (a) Uz, = 0.7518, u(1, 0.2) = 0.7646; (6b) Uio,, = 0.8350, u(1, 0.04) = 0.8356 


10.25 U,, =0.4991 x 107°, u(0.1, 0.1) = 0.1666 x 107° 


10.26 Us, = 0.12333, u(0.9, 0.2) = 0.18 


10.27) Uj, = 0.7633, u(0.5, 0.2) = 0.7592 


10.28 U2, = 0.1680, u(0.2, 0.2) = 0.1666 


10.29 Exact Numerical 


10.30 In both solutions, x(P) = 13/6, u(P) = —5/6. 
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CHAPTER 11 
11.17 Amin min (Am+ti2n + Am-112.0)Umnn t+ Am-12.nUm-1,1 
he 
+ Bnnei2U mnt > (Om nty2t a Un + Bmn-12U m.n=t + CmnUmn = fon 


where, €.2., Gm-1a. represents a mean value (possible choices include the arithmetic, geometric, or 
harmonic mean) between @m-1.n = @(Xm-1, Yay Um-t.n) ANA Amn = A(Xm; Yar Un). 


11.18 Set c =f =0 in Problem 11.17. 


11.19 (a) -4Uy,+ Un t+ Up =0 (6) Ut! =(U5,+ US)/4 

—3U2, + Ui, + U3, = 0 ine uane USY3 
~4U3,+ Uz, + Ux, = -0.25 Ust = (USS! + US + 0.25)/4 
—3U 2+ Unt Ui3=0 Ui = (Uti + US) 
~3Ux2 + Us + U33 = -0.5 USS) = (US! + USF 0.5)/3 
—4U 33+ Ui2 + Ux = —0.25 ries = (ett U4; + 0.25)/4 
—3Ux3 + Uy3+ Us3 = -0.5 US) = (U' + U4 0.593 
—4U33 + U3 + Ux. = -1.5 USS! = (UB + USS" + 1.5)/4 


(c) Cy 


11.20 (a) —-4Unyt+ Uy t+ Uxt Uy2+ Ur, = 0; (b) —4U354+ Uy t 2U 25 = 0; 
(c) —4Us, + Ua + Us2+ 2=0 
(4) 


11.220 UF! = UF + Ret aj} 
11.23 U*F*!= UF + wR*ta;' 


11.24 In (11.8) and (11.9), replace m+ p,ntubymt+yntyp. 
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1 0 0 10 1 
11.25 L=|2 1 0 U=|0 3 2 
13 1 0 0 2 
11.26 (a) (c -—NU nn + on a Un-t.n + | eee Unetiwn dee 
0 -1 -1 0 
1 j}-1 0 oO -1 
b T, = 
0) 7" e-4]-1 0 O -1 
Ou eel Va 0 
o6 2 ae 
oe “¢-4'c-4 
(d) c>6o0rc<2 
CHAPTER 12 
12.12) M={v in HO): v0=0 on x74 y?= 1} 
63 [u; v] = 2| (y7upv, + x? uyvy) dO (u in x, vin M) 
a 
12.13) D={uin WO): u=x? on ?4+ y=), Wlu]=-y'u.—x*u, foruind 
12.14 — Ux — X Uy = F inQ 
y*xu, + x?yu, = 0 on S 
12.15 M= &,, su; o]=2 | [(V7u)(V7v) -— Fo] dO (u,v in M) 
a 
ou 
12.16 B= | in H*(Q):u ae 0 on s|, VJ[u] = 2(V4u - F) for uin D 
a 
a(Weu 
12.17 D= {win H4(Q): Vu = ( anes s|, VJ[u] = 2(V*u - F) for u in @ 
a 
12.19 Minimize 
sul = | (Vu- Vu-—2Fu) an-2| &2u as+| (pu? — 2g3u) dS 
a Sy Sy 
over f = {u in H'(0): u = g, on S;}. 
12.23 (a) Find u in & = {u in H'(Q): u=0 on S} such that 


i (uv, + uy, + 2u,v) dx dy = | v dx dy 
a a 
for all v in & = of. (b) Find u in & = {u in H'(Q): u(x, 2— x) =0 for 0< x <2} such that 
1 l 
i} (Uxds + Uyvy + 2u,v) dx dy = | vdedy+ | (y — 1)v(0, y) dy + | x(x — 1)v(x, 0) dx 
a a 0 ie) 


for all v in M = &. 
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CHAPTER 13 

13.8 uit(x)=0.263x(1— x), ud(x) = 0.177 x(1 — x) + 0.173. x7(1 — x) 

13.9 (a) 0.217 + 0.064 x — 0.007 x?; (b) 0.245 — 0.032 cos wx — 0.00156 cos 27x 
13.10 (7.794 + 0.1702x + 1.0666y)¢, 

13.11 —0.0142. 4, — 0.0075 ¢2 


13.12) ud(x, y)= 14+ 0.029 xy + 0.011 xy(1 + xy) 


13.14 Pe low 
ag SD Gr TOS |e 
1 yp 2 yp 
6 105 15 168 
Rae 42S 
Bu, ee ge, igs 
CHAPTER 14 


-1 3 05 -15 O05 -05 0 15 O 2.55 3.5 15 3.5 
14.6 A=|- 25 ~-2.5 ~-2 2 = 0.5 -0.5 -15 2.5 1 -15 2 -0.5 
-05 O05 25 0.5 1.5 1 1.5 1 1.5 —-2.5 1 2.5 -2 


“o 0 1 1 1 #O-1 =O 1 1 
B=); -1 1 0 0 Q -1 1 1 ~-1 0 0 1 
| 1-1 -1 -1 -1 60-1 0 1 0 1 0 


V3 2 -2 -i1 1 -1 1 2 1 2 1 -1 1 -1 
ates -1 1 2-2 2 1 1 1 1 21 Pie? | 
=] 1. = 1 1 -1 -2 -1 -2 ~-1 1 2 1 2 


14.7) (a) u3(x, y) = 14.3 dils, y)— 14.3 do(x, y) + 50 da(x, y) + 50 do(x, y) — 50 dix, y)— 50 bia(x, y) 
(b) u5(x, y)= 16.32 p1(x, y) — 16.32 pa(x, y) — 14.25 bax, y) — 2.85 s(x, y) + 2.85 ox, y) + 14.25 d(x, y) 
+ 50 da(x, y) + 50 holx, y)— SOdulxy, y)— 50 bralx, y) 
(c) u(x y) = 31.25 p1(x, y) + 10.7 balx, y) + 16.77 ba(x, y) + 6.23 balx, y) + 12.44 bs(x, y) 
148 -1 -1 -1 1-1 0 0 2 00 4 4 0 5 6 4 
A=! 0 1 3-1 1 #1 --1 -2 -2 -3 -4 -4 -4 -6 -1 -2 
2 1-1 1 2 0 2 21 4 4 21 1 5 2 -4 =1 


F-1 O O-1 1 #21 +O -1 ©O O -1 -1 O -1 -1 =1 


° 
i} 
ry 
= 
—) 
| 
_ 
° 
\ 
— 
So 
°o 
| 
m 
° 
° 
| 
= 
° 
~ 
—) 


Cre 0 -1 -1 0 -1 -1 -!1 0 -1 0 1 Oo -1 1 1 -1 
-1 0 oO -1 0 1 Oh Hb eh rel 1 0-1 0 1 


149 (a) ugs=~—2.625 4.41.25 b2— 1.563 + 0.438 bs + 2.532 bs + 3.213 be + 3.258 h7— 1.606 og 
(b) ub = 14.389 bd, — 5.002 + 13.779 b3 + 10.7 hs + 4.888 bs + 1.955 be + 1.222 7 — 0.977 hs 
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A,(R) (surface area of n-ball), 19 Computer programs (continued) 
Adjoint boundary condition, 103, 114 implicit heat equation, 137 
Adjoint operator, 103, 114 implicit wave equation, 152, 153 
Almost-linear system, 51 Lax—Wendroff, 156, 159, 161 
Amplification matrix, 160 Peaceman—Rachford ADI, 139 
Analytic, 20, 103 SOR, 184 
A priori estimates, 21, 29 Wendroff’s implicit, 158 
Auxiliary conditions, 3, 21, 37 Conformal mapping, 102 
Conservation-law system, 52, 58, 63, 148 

Backward heat equation, 37, 45 Consistency condition, 23, 30, 32, 148 
Banded matnx, 168 Consistent difference equation, 125, 133 
Base unit, 8 Consistently ordered, 171 
Bessel’s inequality, 81 Continuous dependence on data, 2, 22 
Biharmonic equation, 122 Dirichlet problem, 29 
Boltzmann variable, 16 nonexistence of, 33, 37, 45, 50 
Bore, 67 Convergence: 
Boundary condition, 2 of iterative methods, 170-172 

adjoint, 103, 114, 115 L* (mean-square), 73 

Dirichlet, 2, 21 pointwise, 72 

flux, 2 uniform, 72 

at infinity, 22, 23, 31 Convergent difference method, 125, 130, 133 

mixed, 2, 21, 30, 32 Convolution, 75 

natural, 195 Coordinate transformation, 5, 6 

Neumann, 2, 21, 30 Boltzmann, 16 

radiation, 2 into canonical form, 11-13 

Robin, 2 to eliminate terms, 15 

stable, 195 linear, 14, 15 
Buckingham Pi Theorem, 8, 16 orthogonal, 14 

Courant minimax principle, 197 

C™ (mth-order continuity), 1 Courant—Friedrichs~Lewy condition, 144 
Calculus of variations, 189 
Canonical equations, 55, 62 D’Alembert solution, 46, 91, 119 
Canonical form, 6, 11-13, 61 Data, 2 
Cauchy problem, 36, 46, 53, 54, 56-58 continuous dependence on, 2, 22, 29 
Cauchy-Riemann equations, 34, 52 Dense subspace, 188 
Celerity, 55 Derivative: 
Characteristic, 5, 11-14, 53, 56, 92 directional, 1 

base curve, 53 distributional, 120 

curve, 5 normal, 1 

equation, 5, 6, 55, 61 partial, 1 

grid, 145 Difference equation, 125, 167 

surface, 6 alternating-direction, 128 
Characteristics, numerical method of, 145, 149, 155, Crank—Nicolson, 127, 128, 141 

162 DuFort—Frankel, 133 

Classical solution, 21 explicit first-order, 146 
Classification, 4-7, 9, 11, 51, 52 explicit heat equation, 127, 129-131 
Closure, 1 explicit wave equation, 144 
Compatibility condition, 39, 49 Hartree, 163 
Complete orthogonal family, 73 implicit, 127 
Computer programs: implicit wave equation, 144 

Crank—Nicolson, 137 Lax—Wendroff, 147, 148, 154, 156, 160 

explicit heat equation, 135 leapfrog, 147 

explicit wave equation, 151 parabolic, 127 

Gauss-Seidel, 184 Peaceman—Rachford, 128, 142 
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Difference equation (continued) Energy integral, 40, 48, 49 
polar coordinates, 176 Equilibrium, 19 
Wendroff’s implicit, 147 Error: 
Difference operator, 125 discretization, 125 
Difference quotient, 124 functions, erf z and erfc z, 16, 77, 123 
Differential operator: rounding, 126, 156 
adjoint, 103, 114, 122 truncation, 124, 125, 156 
elliptic, 20 Euler equation, 190 
linear, 20 Evolution: 
parabolic, 38 diffusionlike, 38 
self-adjoint, 103 equation, 36 
Diffusion equation, 104, 127 (see also Heat Operator, 38 
equation) wavelike, 39 
Diffusionlike evolution, 38 Exterior problem, 22, 31, 32 


infinite speed of propagation, 43, 90 
irreversible process, 45 


smoothing action, 44 Finite element method, 215, 218, 219 
Diffusivity, 8 one-dimensional, 211, 212, 215 
Dimensional analysis, 7, 16, 17 rectangular elements, 214, 218 
Dimensional variable, 17 triangular elements, 213, 316 
Dimensionless quantity, 8 Flow: 

Dirac delta function, 100, 102, 107, 108 adiabatic, 70 
Direct method, 168 fluid, 59, 69 
Dirichlet problem, 22, 26, 29, 94, 102, 110, 114, 167 gas, 51, 52, 70 

continuous dependence, 29 open-channel, 51, 54, 62-67, 71, 163 

exterior, 31 traffic, 69, 71 

Green’s function for, 110, 113 Fourier series, 72, 78 

uniqueness, 25, 29 coefficients, 72, 78 

variational form, 195 convergence theorem, 72 
Discontinuity, 5 cosine series, 78 
Discretization error, 125 sine series, 78 
Discriminant, 4 Fourier transform, 75, 76, 82, 89, 91, 95, 96 
Distribution, 107 Functional, 189 

Dirac delta, 108 comparison functions, 189 

f, 107 domain, 189 

Heaviside, 121 Euler equation, 190 
Divergence, 1 gradient, 189, 190, 194 

form, 52 variation, 189, 193 

theorem, 2, 23 Fundamental dimension, 8 
Domain of dependence, 39, 54, 92 Fundamental solution, 101 
Duhamel’s principle, 50, 943, 100 diffusion equation, 104, 105 


Laplace’s equation, 101 


Eigenfunction, 74, 78 


expansion, 74 Galerkin procedure, 202, 206, 207 
Eigenvalue, 4, 7, 14, 52, 59, 60, 74, 78, 179-182 relation to Rayleigh—Ritz, 206 

Courant minimax principle, 197 trial functions, 203 

Rayleigh quotient, 191, 207 weight functions, 203 

variational principle, 190, 195 Gas-flow equations, 51 
Eigenvector, 52, 59, 60, 179-182 Gauss-Seidel iteration (see Iterative methods) 
Elliptic, 4, 6, 7, 12, 21, 103, 167 Gaussian elimination, 168 

boundary value problem, 21, 22, 31 Generalized function, 107 

exterior, 22, 31 Generalized solution, 190 

canonical form, 7 Gerschgorin Circle Theorem, 142 

system, 52 Ghost point, 134 

type, 4, 7, 9, 52 Gradient, 1 


uniformly, 20, 21 of functional, 189, 190, 194 


Green’s function, 100 
causal, 106 
diffusion equation, 105 
eigenfunction expansion, 102, 111, 115 
elliptic, 103, 115 
free-space, 101, 105, 106, 120 
Laplace's equation, 101-103, 112, 113 
modified, 116 
ordinary differential equation, 112 


partial eigenfunction expansion, 112, 118 


Poisson's equation, 102, 109, 110 
symmetry of, LO9 
wave equation, 106 
Green's identities, 2 
Grid, 124 
nonuniform, 129 
spacing, 124 
uniform, 125 


Hadamard, example by, 33 
Harmonic function, 3, 19, 23-25 
sub-, 20, 25, 34 
super-, 20, 34 
Harnack’s theorem, 34 
Hartree’s method, 163 
Hat functions, 212 
Heat equation, 6, 8, 15-17, 36, 53, 100 
backward, 37, 45 
max-min principle, 37, 40-43 
solutions, 84-90, 98 
uniqueness, 40 
well-posed problems for, 36 
Heaviside function, 121 
Helmholtz equation, 7 
Huygens’ principle, 106 
Hydraulic jump, 67 
Hyperbolic, 4, 6, 7, 11, 39, 52, 144 
Hyperboiic system, 52, 53, 71, 147, 149 
Cauchy problem, 53, 54, 56-58 
characteristic base curves of, 53 
characteristics of, 53-56 
domain of dependence, 54 
initial data for, 53 
interval of dependence, 54 
normal form, 53, 55 


Ill-posed problem, 3, 22, 32, 37 (see also Well-posed 


problem) 

Images, 102, 105, 112-114, 118, 121, 123 
Infinite series, 72 
Initial: 

condition, 2 

curve, 53, 57 

data, 53 
Initial-boundary value problem, 3, 36 


INDEX 


Initial value problem, 36 (see also Cauchy problem) 


heat equation, 36 
Laplace’s equation, 32 
wave equation, 36 
{nner product, 72, 73 
Integral identities, 1, 2 
Integral transform, 75, 84 
Fourier, 75, 76 
Laplace, 76, 77 
International System (SI), 8 
Interval of dependence, 54 
Inversion, 34 
Iteration matrix, 171 
Iterative methods, 154, 168-172 
block, 169 
convergence of, 170, 171 
Gauss-Seidel, 169-172, 185 
Jacobi, 168-172, 182 
LSOR, 169 
point, 169 
SOR, 169-172 


Jacobi iteration (see Iterative methods) 
Jacobian, 57, 62, 148 
Jump conditions, 65-68 (see also Shock) 


Kelvin transformation, 34 


L*[ | (adjoint operator), 103 
L7(Q) (function space), 188 
convergence in, 73 
dense subspaces, 188 
equality in, 73 
Lagrange’s identity, 103, 115 
Lagrange’s interpolation formula, 141 
Laplace transform, 76, 77, 82, 86-89 


Laplace’s equation, 6, 7, 19, 22, 23, 32, 94, 99, 101 


initial value problem for, 33 
Laplacian, 2 

cylindrical coordinates, 34 

spherical coordinates, 34 
Lax Equivalence Theorem, 126 


Lax-Wendroff method, 147, 148, 154, 156, 160 


Linear: 

combination, 188 

operator, 83 

partial differential equation, 1 
LSOR iteration (see Iterative methods) 


McKendrick—von Foerster equation, 51 
Matrix: 
banded, 168 
block tridiagonal, 179 
diagonal, 14, 53, 170 
lower-triangular, 170, 178 
orthogonal, 14 
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Matrix (continued) 
sparse, 168 
symmetric, 4, 7 
tridiagonal, 179 
2-cyclic, 171 
upper-triangular, 170, 178 
Matrix stability (see Stability criteria) 
Maximum-minimum principle, 19 
elliptic, 19-21, 25, 27, 28 
parabolic, 37, 38, 40-42 
Mean-value property, 19, 23-25, 222 
and harmonicity, 23, 25 
and max-min principle, 24 
Mesh, 124 
Method of lines, 141 


Natural boundary condition, 195 

Neumann condition, 2 

Neumann function, 114, 116 

Neumann problem, 30, 35, 95, 116, 134, 172, 195 
quasi-uniqueness, 30 

Node, 124 

Nonlinear partial differential equation, 1 

Norm, 73 

Normal form, 53, 55, 60-62 


O(A) (erdo symbol), 124 
Open-channel flow, 51, 54, 62-67, 71, 163 
Operator, difference (see Difference operator) 
Operator, differential (see Differential operator) 
Optimal SOR, 172 
Order of magnitude, 124 
Order of partial differential equation, 1 
Orthogonal family, 72, 73, 74, 191 

orthonormal family, 72, 73 
Overrelaxation, 169 


P(A) (characteristic polynomial), 52 
Parabolic, 4, 6, 7, 12 
system, 52 
uniformly, 38 
Parseval relation, 74 
Partial derivative, 1 
Partial differential equation, | 
biharmonic, 122 
compressible flow, 59 
conservatiomlaw, 52, 58, 63 
divergence form, 52 
elliptic, 52 
first-order, 51 
gas flow, 51 
Helmholtz, 7 
hyperbolic, 52 
Laplace’s, 32 
linear, 1 
nonlinear, 1 


Partial differential equation (continued) 

open-channel flow, 51, 54, 62 

order of, 1 

parabolic, 52 

Poisson’s, 101 

population density, 51 

quasilinear, 1 

self-adjoint, 103 

solution of, 1 

transmission line, 51 

Tricomi, 4 
PDE (see Partial differential equation) 
Periodic extension, 72, 78, 79 
Periodic function, 72 
Physical dimensions, 8 
Piecewise continuous function, 72 
Plane wave solution, 47 
Poisson integral formula, 22, 23, 25, 35, 95, 123 
Poisson’s equation, 101 
Principal part, 4, 5, 11-14, 17 
Product law, 123 
Proper trianguiation, 213 


Quasilinear, 1, 144 
system, 51, 58 


R” (Euclidean n-space), 1 
Rayleigh quotient, 191, 207 
Rayleigh-Ritz procedure, 202-205, 209 
for eigenvalues, 207, 208 
relation to Galerkin procedure, 206 
Rayleigh’s principle, 197 
Reducing factor, 122 
Reflection, 118 (see also Images; Inversion) 
Relaxation parameter, 169 
Residual, 171 
Retarded potential, 120 
Riemann invariant, 61, 63, 64, 70 


Sectionally continuous function, 72 
Self-adjoint, 103, 122-192 
Separation of variables, 83, 84, 97 
Shock, 54, 66, 68, 69 
Similarity solution, 7, 8, 16 
Similarity variable, 16 
Singularity solution: 
biharmonic equation, 122 
diffusion equation, 104, 117 
Laplace’s equation, 100, 101 
wave equation, 105 
Sink, 113 
Solution, 1 
classical, 21 
discontinuity in, 5, 6 
generalized, 190 
plane wave, 47 
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Solution (continued) Ultrahyperbolic, 4, 7, 17 
similarity, 7, 16 Underrelaxation, 169 
weak, 21, 191, 199 Uniformly elliptic, 20 

SOR (see Successive overrelaxation) Uniformly parabolic, 38 

Source, 113 Uniqueness: 

Sparse matrix, 168 Dirichlet problem, 25, 29 

Spectral radius, 126, 170, 181 exterior problem, 31 

Stability criteria: heat equation, 40, 41 
matrix, 126, 132 mixed problem, 30 
von Neumann, 126, 131, 160 Neumann problem, 30 

Stable boundary condition, 195, 196 wave equation, 48 


Stable difference method, 126 

Steady state, 86, 87 

Stein—Rosenberg theorem, 170 

Sturm—Liouville problem, 74, 78, 80, 84, 85, 97, V,(R) (volume of n-ball), 19 


191, 197-199 Variation, 189, 193 
Sturm—Liouville theorem, 74 Variational formulation, 195, 200 
Subharmonic, 20, 34 Variational principles, 190, 196 
Successive overrelaxation, 169-172, 185 Vector field, 1 
Superharmonic, 20, 34 von Neumann stability (see Stability criteria) 
Superposition, 83, 123 
Surge, 67 
Test function, 65, 107 Wave: 
Transform: equation, 5, 6, 36, 46-50, 90-94, 144 
Founer, 75, 76, 82, 88, 91, 95, 96 traveling, 7 
Laplace, 76, 77, 82, 86-89 velocity, 47 
Transmission line equations, 51 Waveform, 47 
Trial function, 203 Wavelike evolution, 39 
Triangulation, 213 domain of dependence, 47, 92 
Tricomi equation, 4 finite speed of propagation, 47 
Tridiagonal matrix, 128, 132 Weak formulation, 191, 199, 20) 
Truncation error, 124, 185 Weak solution, 65, 67, 69, 71. 191, 192 
local, 125, 129, 150 Weight function, 203 
2-cyclic matrix, 171 Well-posed problem, 3, 22, 36 


Type, 4, 9 Wronskian, 112 


